-- Logs begin at Sun 2022-10-09 00:10:43 UTC, end at Sun 2022-10-09 01:09:44 UTC. -- Oct 09 00:41:41.395674 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 09 00:41:41.404320 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 09 00:41:41.406885 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 9 00:41:41 2022] *** Oct 09 00:41:41.407025 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 09 00:41:41.407145 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 09 00:41:41.407252 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: nodename: dv-osbrick-master-4-iscsi Oct 09 00:41:41.407346 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: machine: x86_64 Oct 09 00:41:41.407433 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: clock source: unix Oct 09 00:41:41.407511 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: pcre jit disabled Oct 09 00:41:41.407612 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: detected number of CPU cores: 4 Oct 09 00:41:41.407716 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: current working directory: / Oct 09 00:41:41.407818 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: detected binary path: /usr/bin/uwsgi-core Oct 09 00:41:41.407925 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: your processes number limit is 47680 Oct 09 00:41:41.408029 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: your memory page size is 4096 bytes Oct 09 00:41:41.408153 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: detected max file descriptor number: 2048 Oct 09 00:41:41.408266 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: lock engine: pthread robust mutexes Oct 09 00:41:41.408523 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: thunder lock: enabled Oct 09 00:41:41.408857 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 09 00:41:41.408984 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 09 00:41:41.448725 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: Python main interpreter initialized at 0x562f1bb199c0 Oct 09 00:41:41.448725 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: python threads support enabled Oct 09 00:41:41.448725 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: your server socket listen backlog is limited to 100 connections Oct 09 00:41:41.448725 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: your mercy for graceful operations on workers is 90 seconds Oct 09 00:41:41.449226 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: mapped 403077 bytes (393 KB) for 2 cores Oct 09 00:41:41.449226 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: *** Operational MODE: preforking *** Oct 09 00:41:41.449468 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: *** uWSGI is running in multiple interpreter mode *** Oct 09 00:41:41.449468 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: spawned uWSGI master process (pid: 81509) Oct 09 00:41:41.449716 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 09 00:41:41.452295 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: spawned uWSGI worker 1 (pid: 81519, cores: 1) Oct 09 00:41:41.452295 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: spawned uWSGI worker 2 (pid: 81520, cores: 1) Oct 09 00:41:41.452295 dv-osbrick-master-4-iscsi devstack@keystone.service[81509]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 09 00:41:45.964275 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 09 00:41:45.964275 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: from cryptography.utils import int_from_bytes Oct 09 00:41:45.965120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 09 00:41:45.965120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: from cryptography.utils import int_from_bytes Oct 09 00:41:45.965120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 09 00:41:45.965120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: from cryptography.utils import int_from_bytes Oct 09 00:41:45.965631 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 09 00:41:45.965631 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: from cryptography.utils import int_from_bytes Oct 09 00:41:46.019698 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 09 00:41:46.019925 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 09 00:41:46.020074 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] command line args: [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 09 00:41:46.020429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 09 00:41:46.020561 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ================================================================================ {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 09 00:41:46.020841 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] admin_token = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.021082 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] config_dir = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.021241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.021441 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] config_source = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.021574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] debug = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.021798 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.023162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.023162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.023162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.023162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.023162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.023162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] log_config_append = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.023508 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.023581 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 09 00:41:46.023663 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] log_dir = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.023736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 09 00:41:46.023808 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] log_file = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.023891 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] command line args: [] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 09 00:41:46.023965 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.024066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 09 00:41:46.024144 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.024229 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ================================================================================ {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 09 00:41:46.024432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.024570 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] admin_token = **** {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.024653 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.024728 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] config_dir = [] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.024795 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.024861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.024926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.024996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] config_source = [] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.025191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] debug = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.025288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.025370 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.025481 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.025559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.025683 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.025761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.025875 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.025952 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.026074 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.026192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.026273 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.026420 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] list_limit = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.026505 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.026584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] log_config_append = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.026697 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.026777 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.026917 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] log_dir = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.027001 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.027075 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] log_file = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.027309 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.027450 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.027538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.027613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] publish_errors = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.027785 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.027865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.028029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.028151 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.028224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.028378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.028465 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.028615 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.028855 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.028935 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] standard_threads = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.029168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.029312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.029392 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.029471 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.029549 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.029645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] use_journal = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.029755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.029841 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] use_json = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.029974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] use_stderr = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.030073 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.030156 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] use_syslog = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.030230 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.030362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.030467 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.030617 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.030848 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.030946 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.031104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.031259 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] publish_errors = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.031392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.031585 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.031714 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.031839 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.031974 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.032130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.032253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.032388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.032513 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.032636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.032760 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] standard_threads = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.032883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.033009 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.033142 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.033278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.033411 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.033535 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.033535 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] use_journal = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.033776 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.033909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] use_json = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.034042 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.034172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] use_stderr = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.034296 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.034426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] use_syslog = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.034426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:41:46.034679 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.034679 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.034910 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.035054 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.035186 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.035315 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.035449 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.035449 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.035687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.035687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.035920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.036064 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.036207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.036339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.036463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.036463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.036715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.036838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.036969 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.037093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.037224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.037355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.037478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.037601 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.037864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.038133 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.038288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.038421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.038556 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.038695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.038827 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.038953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.039083 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.039212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.039353 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.039477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.039603 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.039728 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.039853 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.039978 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.040132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.040262 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.040405 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.040552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.040767 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.040906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.041039 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.041166 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.041289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.041416 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.041543 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.041668 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.041799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.041923 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.042087 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.042223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.042360 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.042484 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.042621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.042746 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.042869 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.042991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.043116 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.043244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.043375 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.043499 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.043623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.043753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.043878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.044022 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.044244 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.044330 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.044404 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.044479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.044551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.044629 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.044710 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.044790 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.044869 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.044869 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.045000 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.045000 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.045137 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.045216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.045328 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.045434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.045532 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.045627 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.045739 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.045843 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.045941 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.046037 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.046143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.046240 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.046345 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.046452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.046574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.046725 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.046860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.046969 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.047091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.047205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.047321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.047435 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.047560 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.047684 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.047810 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.047926 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.048088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.048206 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.048321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.048453 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.048572 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.048703 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.048818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.048922 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.049034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.049147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.049260 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.049382 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.049503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.049609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.049722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.049835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.049948 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.050070 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.050186 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.050307 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.050422 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.050535 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.050648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.050772 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.050886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.051000 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.051114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.051226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.051340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.051462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.051583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.051698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.051819 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.051933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.052060 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.052188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.052304 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.052423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.052538 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.052650 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.052763 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.052889 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.053004 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.053124 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.053244 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.053484 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.053620 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.053757 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.053910 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.054034 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.054156 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.054271 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.054385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.054507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.054630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.054630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.054856 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.054971 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.055085 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.055273 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.055390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.055507 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.055626 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.055741 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.055864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.055988 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.056177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.056295 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.056410 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.056523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.056641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.056756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.056884 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.057000 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.057116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.057230 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.external = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.057343 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.057456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.057578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.057694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.057809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.057922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.058036 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.058150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.password = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.058272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.058395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] auth.token = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.058510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.058624 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.058737 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.058850 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.058997 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.059125 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.059251 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.059368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.059482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.059605 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.059721 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.059836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.059961 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.060091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.060208 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.060323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.060437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.060551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.060679 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.060802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.060919 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.061040 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.061156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] auth.external = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.061278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.061395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.061510 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.061637 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.061754 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.061868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.061983 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.062105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] auth.password = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.062212 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.062314 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] auth.token = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.062429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.062543 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.062658 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.062785 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.062901 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.063016 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.063130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.063244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.063366 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.063491 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.063607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.063722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.063836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.063951 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.064109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.064245 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] credential.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.064363 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.064479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.064594 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.064709 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.064824 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.064947 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.065064 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.065179 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.065294 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.065410 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.065533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.065658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.065775 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.065899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.066015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.066133 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.066247 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.066371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.066489 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.066609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.066724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.066840 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.066963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.067080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.067195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.067310 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.067425 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.067541 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.067664 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.067781 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.067896 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.068011 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] federation.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.068143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.068143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.068372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.068500 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.068694 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.068816 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.068969 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.068969 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.069397 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.069397 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.069677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.069795 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.069920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.070037 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.070160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.070280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.070395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.070510 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.070624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.070740 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.070864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.070980 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.071096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.071210 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.071326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.071326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.071552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.071552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.071770 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.071892 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.072008 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.072170 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.072300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.072418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.072533 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.072647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.072761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.072761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.072994 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.073111 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.073227 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.073341 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.073456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.073571 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.073694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.073811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.073926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.074041 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.074155 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.074270 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.074396 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.074512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.074627 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.074742 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.074858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.074973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.075097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.075214 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.075328 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.075328 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.075549 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.075665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.075789 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.075906 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.076022 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.076157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.076272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.076386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.076513 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.076634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.076749 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.076749 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.076965 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.077080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.077206 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.077322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.077437 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.077551 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.077665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.077788 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.077905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.078021 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.078136 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.078250 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.078365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.078496 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.078614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.078731 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.078845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.078960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.079075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.079199 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.079315 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.079430 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.079552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.079668 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.079784 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.079907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.080023 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.080185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.080303 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.080418 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.080532 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.080659 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.080777 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.080892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.081006 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.081121 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.081237 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.081237 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.081462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.081584 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.081699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.081813 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.081927 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.082051 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.082168 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.082284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.082398 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.082512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.082626 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.082750 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.082866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.082980 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.083095 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.083209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.083324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.083447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.083564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.083680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.083794 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.083908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.084023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.084167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.084286 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.084401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.084514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.084814 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.084940 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.085095 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.085217 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.085333 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.085449 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.085564 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.085678 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.085802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.085919 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.086033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.086147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.086262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.086383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.086510 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.086627 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.086746 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.086861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.086976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.087091 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.087214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.087331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.087446 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.087562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.087677 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.087792 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.087915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.088032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.088197 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.088311 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.088426 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.088541 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.088669 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.088787 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.088901 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.089016 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.089130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.089244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.089367 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.089484 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.089599 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.089713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.089827 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.089942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.090065 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.090181 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.090302 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.090418 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.090533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] role.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.090649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.090773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] role.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.090881 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.090995 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.091110 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.091224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.091338 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.091465 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.091583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.091699 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.091813 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.091919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.092128 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.092250 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.092365 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] resource.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.092480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.092596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.092713 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.092836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.092954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.093069 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.093183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.093298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.093412 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.093534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.093651 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.093768 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.093882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.093997 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.094112 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.094235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.094351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.094466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.094580 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.094701 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] role.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.094818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.094942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] role.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.094942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.095160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.095160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.095373 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.095488 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.095610 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.095728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.095844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.095958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.096092 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.096208 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.096337 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.096454 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.096569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.096687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.096803 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.096919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.097042 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.097159 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.097273 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.097387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.097502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.097616 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.097739 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.097856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.097971 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.098086 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.098209 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.098334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.098450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.098565 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.098679 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.098794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] token.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.098794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.099018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.099136 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.099365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.099479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.099592 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.099715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.099832 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.099946 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.100108 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.100249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.100422 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.100630 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.100802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.100923 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.101039 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.101156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.101271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.101396 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.101523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.101641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.101756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.101872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.101987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.102110 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.102229 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.102344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.102459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.102583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.102708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.102825 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.102948 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.103065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.103065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] token.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.103281 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.connection = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.103396 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.103511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.103634 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.103750 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.103865 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.103979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.103979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.104211 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.104340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.104458 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.104574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.104688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.104802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.104917 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.105039 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.105156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.105271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.105386 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.105386 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.105609 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.105733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.105850 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.105964 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.106078 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.106192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.106306 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.106431 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.106547 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.106665 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.106790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.106915 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107031 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107382 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.connection = **** {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 09 00:41:46.107715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.107715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.108695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.108695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.108695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.108695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.108695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.108695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.108695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.108695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.108695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:41:46.109621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 09 00:41:46.131614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.131833 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.132112 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.134708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.134935 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.135155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.140673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.143448 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.168260 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.168484 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.169376 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.169600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.221596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.222276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.269770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.269975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.270360 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.270594 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.425358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.425540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.425689 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.425775 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.425908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.425993 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.426104 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.426187 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.426253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.426339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.426418 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.426665 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.448792 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.449021 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.449243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.449389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.449532 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.449655 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.449774 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.449892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.450022 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.450106 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.450225 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.450307 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.450307 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.450463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.461005 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.461369 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.473513 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.473711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.473809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.473912 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.473993 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.474152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.474283 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.474427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.474525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.474606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.474684 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.474761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.474837 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.475012 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:41:46.492303 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.492469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.492542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 09 00:41:46.492626 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 09 00:41:46.492827 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.492988 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.493132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 09 00:41:46.493232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 09 00:41:46.493355 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.493439 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.493561 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.493645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.493709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.493786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.493987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.494114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.503395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.503524 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.503664 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.503750 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.503917 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.504085 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.504227 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.504312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.511449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.511578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.514330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.514460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.514598 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.514684 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.514870 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.514998 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.515156 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.515243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.515414 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.515541 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.515680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.515777 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.515895 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.515979 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.516200 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.516328 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.516488 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.516575 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.516720 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.516847 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.516986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.517068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.539209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.539336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.540686 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.540815 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.540946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.541052 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.545524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.545653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.545792 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.545876 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.546058 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.546186 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.552288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.552417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.552555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.552676 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.558326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.558460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.558600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.558683 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.558874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.559020 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.559162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.559285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.559406 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.559523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.559653 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.559736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.559911 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.560064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.560247 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.560342 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.575574 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.575707 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.575832 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.575917 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.579667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.579814 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.582904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.583033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.583164 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.583249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.587448 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.587576 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.590626 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.590754 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.593820 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.593965 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.594107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.594189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.594353 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.594447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.594647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.594771 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.594901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.594987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.595181 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.595402 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.610828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.610957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.611079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.611194 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.611357 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.611472 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.611584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.611666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.618406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.618532 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.619931 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.620143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.621471 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.621598 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.621729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.621814 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.624372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.624595 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.624698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.624844 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.624970 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.625127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.625214 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.625386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.625527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.625772 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.636941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.637077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.637219 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.637423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.637549 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.637703 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.637793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.637934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.638181 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.638276 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.638354 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.638590 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.638811 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.653958 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.654109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.656862 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.656993 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.659713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.659843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.661232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.661362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.662741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.662908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.663038 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.663164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.663473 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.663606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.669730 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.669954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.671181 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.671329 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.674046 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.674176 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.674433 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.674563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.674703 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.674801 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.674929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.675010 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.682789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.683004 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.683144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.683297 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.683384 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.683589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.690042 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.690316 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.690460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:46.690601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.690717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.690801 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.691008 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.691150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.691290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.691375 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.691532 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.691659 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.691811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.691907 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.692028 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.692184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.692322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.692418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.692624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.692752 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.692868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.693011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.693131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.693223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.693391 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.693486 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.693671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.693960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:46.727267 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f1bb199c0 pid: 81519 (default app) Oct 09 00:41:46.727752 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f1bb199c0 pid: 81520 (default app) Oct 09 00:41:46.730586 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5c3d-68b5-4825-925d-3d398f38a50a None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:46.730869 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5c3d-68b5-4825-925d-3d398f38a50a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:46.731133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5c3d-68b5-4825-925d-3d398f38a50a None None] PATH_INFO: `/v3` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:46.735269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Sun Oct 9 00:41:46 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:53.616426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f9449-954b-418c-b4f5-2021d9a0a408 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:53.616972 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f9449-954b-418c-b4f5-2021d9a0a408 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:53.616972 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f9449-954b-418c-b4f5-2021d9a0a408 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:53.621249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:41:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:53.626729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c0ec-47bc-4e67-9245-1a980d14a8c7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:53.627254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c0ec-47bc-4e67-9245-1a980d14a8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:53.627254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c0ec-47bc-4e67-9245-1a980d14a8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:53.697952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: INFO dbcounter [None req-3ae2c0ec-47bc-4e67-9245-1a980d14a8c7 None None] Registered counter for database keystone Oct 09 00:41:53.718853 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG oslo_db.sqlalchemy.engines [None req-3ae2c0ec-47bc-4e67-9245-1a980d14a8c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 09 00:41:53.730199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writer thread running {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 09 00:41:53.929345 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG passlib.handlers.bcrypt [None req-3ae2c0ec-47bc-4e67-9245-1a980d14a8c7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81519) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 09 00:41:53.929652 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG passlib.handlers.bcrypt [None req-3ae2c0ec-47bc-4e67-9245-1a980d14a8c7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81519) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 09 00:41:53.988180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-3ae2c0ec-47bc-4e67-9245-1a980d14a8c7 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:53.989793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3ae2c0ec-47bc-4e67-9245-1a980d14a8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:54.140069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 09 00:41:54.439076 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f9449-954b-418c-b4f5-2021d9a0a408 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:54.510979 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: INFO dbcounter [None req-a75f9449-954b-418c-b4f5-2021d9a0a408 None None] Registered counter for database keystone Oct 09 00:41:54.536130 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG oslo_db.sqlalchemy.engines [None req-a75f9449-954b-418c-b4f5-2021d9a0a408 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 09 00:41:54.547109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writer thread running {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 09 00:41:54.678440 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f9449-954b-418c-b4f5-2021d9a0a408 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:54.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdff8f0-a7a9-4844-97b7-bcd2b5c5deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:54.684851 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdff8f0-a7a9-4844-97b7-bcd2b5c5deb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:54.685124 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdff8f0-a7a9-4844-97b7-bcd2b5c5deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:54.685389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdff8f0-a7a9-4844-97b7-bcd2b5c5deb6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:54.698360 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdff8f0-a7a9-4844-97b7-bcd2b5c5deb6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:54.749179 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4cdff8f0-a7a9-4844-97b7-bcd2b5c5deb6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 09 00:41:54.749529 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdff8f0-a7a9-4844-97b7-bcd2b5c5deb6 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:54.760234 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Sun Oct 9 00:41:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:41:54.766702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2c0ec-47bc-4e67-9245-1a980d14a8c7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:54.785591 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2c0ec-47bc-4e67-9245-1a980d14a8c7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:54.790817 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aa0db-9780-4049-aee6-8bf0b5843162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:54.792031 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aa0db-9780-4049-aee6-8bf0b5843162 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:54.792237 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aa0db-9780-4049-aee6-8bf0b5843162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:54.792478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aa0db-9780-4049-aee6-8bf0b5843162 admin admin] PATH_INFO: `/v3/projects/b4515502f4ca44c3b302803eb9e3faf6` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:54.794120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aa0db-9780-4049-aee6-8bf0b5843162 admin admin] RBAC: Authorizing `identity:get_project(project_id=b4515502f4ca44c3b302803eb9e3faf6)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:54.846036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: WARNING keystone.common.rbac_enforcer.enforcer [None req-567aa0db-9780-4049-aee6-8bf0b5843162 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 09 00:41:54.846379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aa0db-9780-4049-aee6-8bf0b5843162 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:54.850994 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Sun Oct 9 00:41:54 2022] GET /identity/v3/projects/b4515502f4ca44c3b302803eb9e3faf6 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:56.970233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334a82-b5b9-41e6-96bf-78cd6f5047bf None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.971158 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334a82-b5b9-41e6-96bf-78cd6f5047bf None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.971158 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334a82-b5b9-41e6-96bf-78cd6f5047bf None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:56.977434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:41:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:56.984641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33c421-bdca-48ec-9f48-b0b6bb0dad2e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.985098 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33c421-bdca-48ec-9f48-b0b6bb0dad2e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.985192 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33c421-bdca-48ec-9f48-b0b6bb0dad2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.013630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6d33c421-bdca-48ec-9f48-b0b6bb0dad2e None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:57.015122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6d33c421-bdca-48ec-9f48-b0b6bb0dad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:57.024363 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 09 00:41:57.283804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95334a82-b5b9-41e6-96bf-78cd6f5047bf None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:57.305194 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95334a82-b5b9-41e6-96bf-78cd6f5047bf None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:57.310504 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84a657-d55d-4529-8957-59afeacee0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:57.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a657-d55d-4529-8957-59afeacee0ec admin admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:57.311389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a657-d55d-4529-8957-59afeacee0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:57.311658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a657-d55d-4529-8957-59afeacee0ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.319983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84a657-d55d-4529-8957-59afeacee0ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:57.321825 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84a657-d55d-4529-8957-59afeacee0ec admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:57.330918 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Sun Oct 9 00:41:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:41:57.336497 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33c421-bdca-48ec-9f48-b0b6bb0dad2e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:57.345947 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33c421-bdca-48ec-9f48-b0b6bb0dad2e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:57.351941 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d90d-c7d9-4826-a18a-61e98af66946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:57.352587 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d90d-c7d9-4826-a18a-61e98af66946 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:57.352860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d90d-c7d9-4826-a18a-61e98af66946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:57.353127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d90d-c7d9-4826-a18a-61e98af66946 admin admin] PATH_INFO: `/v3/users/98027de25a1b4edcab7ee4843ee0a448` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.354657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d90d-c7d9-4826-a18a-61e98af66946 admin admin] RBAC: Authorizing `identity:get_user(user_id=98027de25a1b4edcab7ee4843ee0a448)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:57.356541 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d90d-c7d9-4826-a18a-61e98af66946 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:57.358059 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Sun Oct 9 00:41:57 2022] GET /identity/v3/users/98027de25a1b4edcab7ee4843ee0a448 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:59.532736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165bbf9-903a-4a27-8f7a-6855b54776ea None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:59.533312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165bbf9-903a-4a27-8f7a-6855b54776ea None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:59.533312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165bbf9-903a-4a27-8f7a-6855b54776ea None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:59.534553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:41:59.540139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328108d6-b95d-414d-ad52-1b887297fc9c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:59.540569 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328108d6-b95d-414d-ad52-1b887297fc9c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:59.540718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328108d6-b95d-414d-ad52-1b887297fc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:59.559664 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-328108d6-b95d-414d-ad52-1b887297fc9c None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:59.560888 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-328108d6-b95d-414d-ad52-1b887297fc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:59.609569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a9497-38c2-45f0-918b-97b05cb63e71 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:59.609910 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a9497-38c2-45f0-918b-97b05cb63e71 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:59.610156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a9497-38c2-45f0-918b-97b05cb63e71 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:59.611694 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:59.617055 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4b01-5212-4783-9289-fdddaa9520a1 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:59.617336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4b01-5212-4783-9289-fdddaa9520a1 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:59.617605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4b01-5212-4783-9289-fdddaa9520a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:59.649366 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:59.660425 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG passlib.handlers.bcrypt [None req-5f5b4b01-5212-4783-9289-fdddaa9520a1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81520) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 09 00:41:59.660837 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG passlib.handlers.bcrypt [None req-5f5b4b01-5212-4783-9289-fdddaa9520a1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81520) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 09 00:41:59.709913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-5f5b4b01-5212-4783-9289-fdddaa9520a1 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:59.711499 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-5f5b4b01-5212-4783-9289-fdddaa9520a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:59.814240 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:59.917052 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328108d6-b95d-414d-ad52-1b887297fc9c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:59.944388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:00.027940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328108d6-b95d-414d-ad52-1b887297fc9c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:00.063228 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2566a06-7111-4558-a66f-f77372b6cf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:00.063789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566a06-7111-4558-a66f-f77372b6cf39 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.064076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566a06-7111-4558-a66f-f77372b6cf39 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.064365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566a06-7111-4558-a66f-f77372b6cf39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.072430 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b4b01-5212-4783-9289-fdddaa9520a1 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:00.077262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2566a06-7111-4558-a66f-f77372b6cf39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b2566a06-7111-4558-a66f-f77372b6cf39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:00.086183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:00.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:00.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:41:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:00.093003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2566a06-7111-4558-a66f-f77372b6cf39 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:00.179009 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:00.186644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b4b01-5212-4783-9289-fdddaa9520a1 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:00.188908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:00.197348 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2566a06-7111-4558-a66f-f77372b6cf39 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:00.223748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e64c3-eb8a-4f80-838f-f2ed3c2b167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:00.224646 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e64c3-eb8a-4f80-838f-f2ed3c2b167f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.224924 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e64c3-eb8a-4f80-838f-f2ed3c2b167f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.225338 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e64c3-eb8a-4f80-838f-f2ed3c2b167f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.230688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4655410-6c65-4331-bc23-ea9a6a2fc65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:00.231299 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655410-6c65-4331-bc23-ea9a6a2fc65e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.231573 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655410-6c65-4331-bc23-ea9a6a2fc65e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.231842 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4655410-6c65-4331-bc23-ea9a6a2fc65e None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.232532 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4655410-6c65-4331-bc23-ea9a6a2fc65e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:00.232832 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4655410-6c65-4331-bc23-ea9a6a2fc65e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:00.234239 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4655410-6c65-4331-bc23-ea9a6a2fc65e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:00.245968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:00.251708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4655410-6c65-4331-bc23-ea9a6a2fc65e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:00.294817 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e64c3-eb8a-4f80-838f-f2ed3c2b167f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:00.296389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e64c3-eb8a-4f80-838f-f2ed3c2b167f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:00.351290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4655410-6c65-4331-bc23-ea9a6a2fc65e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:00.384309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51a26-3293-4c1a-b2ab-c16b01aa5dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:00.384942 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51a26-3293-4c1a-b2ab-c16b01aa5dfe None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.385220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51a26-3293-4c1a-b2ab-c16b01aa5dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.385500 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51a26-3293-4c1a-b2ab-c16b01aa5dfe None admin] PATH_INFO: `/v3/users/98027de25a1b4edcab7ee4843ee0a448` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.386651 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae51a26-3293-4c1a-b2ab-c16b01aa5dfe None admin] RBAC: Authorizing `identity:get_user(user_id=98027de25a1b4edcab7ee4843ee0a448)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:00.388151 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae51a26-3293-4c1a-b2ab-c16b01aa5dfe None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:00.389728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/users/98027de25a1b4edcab7ee4843ee0a448 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:00.395343 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51a26-3293-4c1a-b2ab-c16b01aa5dfe None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:00.398903 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 8/17] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:00.404274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e64c3-eb8a-4f80-838f-f2ed3c2b167f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:00.407171 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:00.410765 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:00.496486 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51a26-3293-4c1a-b2ab-c16b01aa5dfe None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:00.503815 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e64c3-eb8a-4f80-838f-f2ed3c2b167f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:00.530742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724db1b-7650-4460-98f0-375e7e639612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:00.531371 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724db1b-7650-4460-98f0-375e7e639612 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.531648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724db1b-7650-4460-98f0-375e7e639612 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.531916 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724db1b-7650-4460-98f0-375e7e639612 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.533085 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724db1b-7650-4460-98f0-375e7e639612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:00.534559 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724db1b-7650-4460-98f0-375e7e639612 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:00.536138 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:00.537749 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a016b-5066-4031-98e6-4c4db69bbaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:00.538667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a016b-5066-4031-98e6-4c4db69bbaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.539000 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a016b-5066-4031-98e6-4c4db69bbaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.539326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a016b-5066-4031-98e6-4c4db69bbaf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.541936 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724db1b-7650-4460-98f0-375e7e639612 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:00.558023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a016b-5066-4031-98e6-4c4db69bbaf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:00.559478 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a016b-5066-4031-98e6-4c4db69bbaf3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-7a5a016b-5066-4031-98e6-4c4db69bbaf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:00.577080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:00.578050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:00.578884 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:00.578884 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:00.578884 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:00.578884 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:00.583874 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a016b-5066-4031-98e6-4c4db69bbaf3 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:00.624761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:00.641101 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:00.647015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724db1b-7650-4460-98f0-375e7e639612 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:00.681060 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dce8c-8f36-47ea-bac1-1bfdfb1bde35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:00.681672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dce8c-8f36-47ea-bac1-1bfdfb1bde35 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.681946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dce8c-8f36-47ea-bac1-1bfdfb1bde35 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.682214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dce8c-8f36-47ea-bac1-1bfdfb1bde35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.682932 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dce8c-8f36-47ea-bac1-1bfdfb1bde35 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.domain.id=default, user.id=98027de25a1b4edcab7ee4843ee0a448) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:00.683230 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dce8c-8f36-47ea-bac1-1bfdfb1bde35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:00.684732 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dce8c-8f36-47ea-bac1-1bfdfb1bde35 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:00.688169 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a016b-5066-4031-98e6-4c4db69bbaf3 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:00.691241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/role_assignments?user.id=98027de25a1b4edcab7ee4843ee0a448&scope.domain.id=default&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:00.723033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8a63f-437a-4ca3-96f8-d5b3f68f7e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:00.723776 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a63f-437a-4ca3-96f8-d5b3f68f7e81 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.724134 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a63f-437a-4ca3-96f8-d5b3f68f7e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.724411 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a63f-437a-4ca3-96f8-d5b3f68f7e81 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.725413 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8a63f-437a-4ca3-96f8-d5b3f68f7e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:00.725564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8a63f-437a-4ca3-96f8-d5b3f68f7e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:00.727103 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8a63f-437a-4ca3-96f8-d5b3f68f7e81 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:00.746735 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:03.053748 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f3977-28a2-4f15-93d3-5a5563268e50 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:03.054822 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f3977-28a2-4f15-93d3-5a5563268e50 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:03.055320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f3977-28a2-4f15-93d3-5a5563268e50 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:03.056968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:03.062171 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fc169-ad7d-4ee3-b7c0-476fcf41463b None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:03.063008 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fc169-ad7d-4ee3-b7c0-476fcf41463b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:03.063468 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fc169-ad7d-4ee3-b7c0-476fcf41463b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:03.093277 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-4d3fc169-ad7d-4ee3-b7c0-476fcf41463b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:03.094915 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-4d3fc169-ad7d-4ee3-b7c0-476fcf41463b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:03.177395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:03.399466 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7009f3-7271-4a2d-a0e5-9be549072d10 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:03.400158 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7009f3-7271-4a2d-a0e5-9be549072d10 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:03.400637 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7009f3-7271-4a2d-a0e5-9be549072d10 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:03.402234 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:03.408176 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397700f-3ffd-456a-a3ac-413943b9398e None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:03.408743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397700f-3ffd-456a-a3ac-413943b9398e None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:03.409273 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397700f-3ffd-456a-a3ac-413943b9398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:03.432882 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-3397700f-3ffd-456a-a3ac-413943b9398e None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:03.434443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3397700f-3ffd-456a-a3ac-413943b9398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:03.486752 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:03.520509 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 12/25] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:03.667078 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7009f3-7271-4a2d-a0e5-9be549072d10 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:03.777536 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c2d95-d9bc-4819-90a9-c949ddfc6e50 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:03.777870 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c2d95-d9bc-4819-90a9-c949ddfc6e50 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:03.778080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c2d95-d9bc-4819-90a9-c949ddfc6e50 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:03.779575 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 13/26] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:03.784724 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411765d2-6464-4850-9d2e-db839f173451 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:03.784999 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411765d2-6464-4850-9d2e-db839f173451 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:03.785270 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411765d2-6464-4850-9d2e-db839f173451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:03.814915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7009f3-7271-4a2d-a0e5-9be549072d10 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:03.819660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-411765d2-6464-4850-9d2e-db839f173451 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:03.820902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-411765d2-6464-4850-9d2e-db839f173451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:03.890221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb07bf9-1990-40ee-bc1c-4b33e0358ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:03.890867 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb07bf9-1990-40ee-bc1c-4b33e0358ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:03.891141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb07bf9-1990-40ee-bc1c-4b33e0358ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:03.891406 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb07bf9-1990-40ee-bc1c-4b33e0358ca3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:03.914330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb07bf9-1990-40ee-bc1c-4b33e0358ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-dbb07bf9-1990-40ee-bc1c-4b33e0358ca3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:03.921630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:03.922717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:03.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:03.931175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 14/27] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:03.935644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb07bf9-1990-40ee-bc1c-4b33e0358ca3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:03.940745 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:03.967326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 14/28] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:04.031346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411765d2-6464-4850-9d2e-db839f173451 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:04.071474 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb07bf9-1990-40ee-bc1c-4b33e0358ca3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:04.111901 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760c12d-15e0-482f-a324-f935995fe551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:04.112544 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760c12d-15e0-482f-a324-f935995fe551 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.112819 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760c12d-15e0-482f-a324-f935995fe551 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.113086 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760c12d-15e0-482f-a324-f935995fe551 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.113751 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760c12d-15e0-482f-a324-f935995fe551 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:04.114052 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760c12d-15e0-482f-a324-f935995fe551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:04.115459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760c12d-15e0-482f-a324-f935995fe551 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:04.128831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 15/29] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:04.129800 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd8dd-2858-466f-b966-e0ec23d22bbe None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.130092 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd8dd-2858-466f-b966-e0ec23d22bbe None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.130364 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd8dd-2858-466f-b966-e0ec23d22bbe None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.132977 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:04.138033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dd8dd-2858-466f-b966-e0ec23d22bbe None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:04.212174 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411765d2-6464-4850-9d2e-db839f173451 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:04.216462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:04.235539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:04.266700 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe0a9e-a962-4a76-8090-19505d6802c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:04.267777 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe0a9e-a962-4a76-8090-19505d6802c9 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.269068 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe0a9e-a962-4a76-8090-19505d6802c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.269685 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe0a9e-a962-4a76-8090-19505d6802c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.271951 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe0a9e-a962-4a76-8090-19505d6802c9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:04.274132 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe0a9e-a962-4a76-8090-19505d6802c9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:04.307852 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dd8dd-2858-466f-b966-e0ec23d22bbe None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:04.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4f353-7c78-4ec9-9423-a178ae2f46a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:04.362851 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4f353-7c78-4ec9-9423-a178ae2f46a3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.363350 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4f353-7c78-4ec9-9423-a178ae2f46a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.363811 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4f353-7c78-4ec9-9423-a178ae2f46a3 None admin] PATH_INFO: `/v3/users/98027de25a1b4edcab7ee4843ee0a448` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.365180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4f353-7c78-4ec9-9423-a178ae2f46a3 None admin] RBAC: Authorizing `identity:get_user(user_id=98027de25a1b4edcab7ee4843ee0a448)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:04.366930 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4f353-7c78-4ec9-9423-a178ae2f46a3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:04.369214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 17/31] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:04 2022] GET /identity/v3/users/98027de25a1b4edcab7ee4843ee0a448 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:04.370637 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0c589-96f9-49be-8ef9-2f32b26ba5ea None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.371125 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0c589-96f9-49be-8ef9-2f32b26ba5ea None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.371583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0c589-96f9-49be-8ef9-2f32b26ba5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.391819 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-3df0c589-96f9-49be-8ef9-2f32b26ba5ea None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:04.393365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3df0c589-96f9-49be-8ef9-2f32b26ba5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:04.436514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 15/32] 10.222.0.43 () {60 vars in 1131 bytes} [Sun Oct 9 00:42:04 2022] POST /identity/v3/roles => generated 219 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:04.437335 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe0a9e-a962-4a76-8090-19505d6802c9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:04.477451 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 18/33] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:04.478729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0c589-96f9-49be-8ef9-2f32b26ba5ea None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:04.614203 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:04.620631 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe0a9e-a962-4a76-8090-19505d6802c9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:04.667641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b53e5e-e892-4af1-94d9-833fbd9c3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:04.668743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b53e5e-e892-4af1-94d9-833fbd9c3767 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.670402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b53e5e-e892-4af1-94d9-833fbd9c3767 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.670888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b53e5e-e892-4af1-94d9-833fbd9c3767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.695353 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b53e5e-e892-4af1-94d9-833fbd9c3767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:04.696706 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0c589-96f9-49be-8ef9-2f32b26ba5ea None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:04.699353 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b53e5e-e892-4af1-94d9-833fbd9c3767 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-80b53e5e-e892-4af1-94d9-833fbd9c3767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:04.734566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:04.735493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:04.736358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:04.736358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:04.736358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:04.738529 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 16/34] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:04.744663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b53e5e-e892-4af1-94d9-833fbd9c3767 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:04.779630 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:04.780262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e50ec-7379-4707-9247-b1ee6f135100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:04.780920 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e50ec-7379-4707-9247-b1ee6f135100 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.781481 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e50ec-7379-4707-9247-b1ee6f135100 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.781481 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e50ec-7379-4707-9247-b1ee6f135100 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.785914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e50ec-7379-4707-9247-b1ee6f135100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:04.787699 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e50ec-7379-4707-9247-b1ee6f135100 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:04.791013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 19/35] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:04.795759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e50ec-7379-4707-9247-b1ee6f135100 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:04.907046 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b53e5e-e892-4af1-94d9-833fbd9c3767 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:04.929103 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e50ec-7379-4707-9247-b1ee6f135100 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:04.948317 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87262-1b76-4c90-8e9b-ac6ca0b0f1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:04.949296 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87262-1b76-4c90-8e9b-ac6ca0b0f1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.949703 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87262-1b76-4c90-8e9b-ac6ca0b0f1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.950159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87262-1b76-4c90-8e9b-ac6ca0b0f1a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.951183 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f87262-1b76-4c90-8e9b-ac6ca0b0f1a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:04.951556 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f87262-1b76-4c90-8e9b-ac6ca0b0f1a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:04.954105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f87262-1b76-4c90-8e9b-ac6ca0b0f1a4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:04.963463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:04.967324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 17/36] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:04.968196 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87262-1b76-4c90-8e9b-ac6ca0b0f1a4 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:04.973194 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291410c7-1271-43ca-95b1-888538a37799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:04.973873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291410c7-1271-43ca-95b1-888538a37799 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.974150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291410c7-1271-43ca-95b1-888538a37799 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.974419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291410c7-1271-43ca-95b1-888538a37799 None admin] PATH_INFO: `/v3/domains/default/users/98027de25a1b4edcab7ee4843ee0a448/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.976488 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291410c7-1271-43ca-95b1-888538a37799 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=98027de25a1b4edcab7ee4843ee0a448, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:04.977962 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291410c7-1271-43ca-95b1-888538a37799 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.054385 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:05.077552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87262-1b76-4c90-8e9b-ac6ca0b0f1a4 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.105835 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 20/37] 10.222.0.43 () {58 vars in 1361 bytes} [Sun Oct 9 00:42:04 2022] PUT /identity/v3/domains/default/users/98027de25a1b4edcab7ee4843ee0a448/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:05.105835 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3eeb-e9ee-4498-abce-7d882b7086cc None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.105835 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3eeb-e9ee-4498-abce-7d882b7086cc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.105835 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3eeb-e9ee-4498-abce-7d882b7086cc None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.105835 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 21/38] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:05.105835 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3eeb-e9ee-4498-abce-7d882b7086cc None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:05.125268 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a11b4a-efc4-4b9d-a7b2-c2c1d9cc40b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.125906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a11b4a-efc4-4b9d-a7b2-c2c1d9cc40b4 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.126189 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a11b4a-efc4-4b9d-a7b2-c2c1d9cc40b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.126462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a11b4a-efc4-4b9d-a7b2-c2c1d9cc40b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.127392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a11b4a-efc4-4b9d-a7b2-c2c1d9cc40b4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.128671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a11b4a-efc4-4b9d-a7b2-c2c1d9cc40b4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.148446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 18/39] 10.222.0.43 () {60 vars in 1131 bytes} [Sun Oct 9 00:42:04 2022] POST /identity/v3/roles => generated 225 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:05.148446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787f15d-a308-487b-9a92-0d9a96e0528c None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.148446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787f15d-a308-487b-9a92-0d9a96e0528c None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.148446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787f15d-a308-487b-9a92-0d9a96e0528c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.173414 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-9787f15d-a308-487b-9a92-0d9a96e0528c None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:05.175299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-9787f15d-a308-487b-9a92-0d9a96e0528c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:05.269080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 19/40] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:05.271387 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8322aa5-0a88-4706-88c1-632bdd35d1e4 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.271938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8322aa5-0a88-4706-88c1-632bdd35d1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.272494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8322aa5-0a88-4706-88c1-632bdd35d1e4 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.274075 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 20/41] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:05.281761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f287b03-1cb0-406c-9a51-5cd4172cac0d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.282523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f287b03-1cb0-406c-9a51-5cd4172cac0d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.282996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f287b03-1cb0-406c-9a51-5cd4172cac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.314801 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-0f287b03-1cb0-406c-9a51-5cd4172cac0d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:05.316127 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-0f287b03-1cb0-406c-9a51-5cd4172cac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:05.369522 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3eeb-e9ee-4498-abce-7d882b7086cc None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.390989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:05.398983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 21/42] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:05.407858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f8f6c-2b89-4dc8-899f-c275a67a1ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.408843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f8f6c-2b89-4dc8-899f-c275a67a1ce0 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.409351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f8f6c-2b89-4dc8-899f-c275a67a1ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.409847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f8f6c-2b89-4dc8-899f-c275a67a1ce0 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.410709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f8f6c-2b89-4dc8-899f-c275a67a1ce0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.412704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f8f6c-2b89-4dc8-899f-c275a67a1ce0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.450398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 22/43] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:42:05 2022] POST /identity/v3/projects => generated 301 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:05.568140 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f287b03-1cb0-406c-9a51-5cd4172cac0d None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:05.676831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f287b03-1cb0-406c-9a51-5cd4172cac0d None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.712392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73df2-b397-4692-9505-2bdf20fe95cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.713183 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73df2-b397-4692-9505-2bdf20fe95cf None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.713560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73df2-b397-4692-9505-2bdf20fe95cf None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.713925 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73df2-b397-4692-9505-2bdf20fe95cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.715407 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc73df2-b397-4692-9505-2bdf20fe95cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.717015 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc73df2-b397-4692-9505-2bdf20fe95cf None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.719072 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 22/44] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:05.724884 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f8f6c-2b89-4dc8-899f-c275a67a1ce0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:05.735366 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73df2-b397-4692-9505-2bdf20fe95cf None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:05.775602 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:05.811400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:05.840202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f8f6c-2b89-4dc8-899f-c275a67a1ce0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.853432 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73df2-b397-4692-9505-2bdf20fe95cf None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.876545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b20204-079b-4d55-931b-3eb7682626d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.877162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b20204-079b-4d55-931b-3eb7682626d8 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.877441 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b20204-079b-4d55-931b-3eb7682626d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.877712 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b20204-079b-4d55-931b-3eb7682626d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.878452 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b20204-079b-4d55-931b-3eb7682626d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.879833 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b20204-079b-4d55-931b-3eb7682626d8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.887501 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9246a10-02e9-44e6-87d1-cb762de9c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.888224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9246a10-02e9-44e6-87d1-cb762de9c65f None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.888572 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9246a10-02e9-44e6-87d1-cb762de9c65f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.888909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9246a10-02e9-44e6-87d1-cb762de9c65f None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.889652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9246a10-02e9-44e6-87d1-cb762de9c65f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.891099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9246a10-02e9-44e6-87d1-cb762de9c65f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.908253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 23/45] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:42:05 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:05.908441 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 23/46] 10.222.0.43 () {60 vars in 1131 bytes} [Sun Oct 9 00:42:05 2022] POST /identity/v3/roles => generated 223 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:42:07.394175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70abcd-6dc9-4f3c-a214-89b0536a4040 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:07.394757 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70abcd-6dc9-4f3c-a214-89b0536a4040 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:07.394757 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70abcd-6dc9-4f3c-a214-89b0536a4040 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:07.396076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 24/47] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:07.401614 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b8370-4be5-4161-a053-8bfe09e27903 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:07.402050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b8370-4be5-4161-a053-8bfe09e27903 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:07.402157 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b8370-4be5-4161-a053-8bfe09e27903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:07.421685 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-f48b8370-4be5-4161-a053-8bfe09e27903 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:07.422878 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-f48b8370-4be5-4161-a053-8bfe09e27903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:07.492492 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 24/48] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:07.764538 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70abcd-6dc9-4f3c-a214-89b0536a4040 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:07.868922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:07.877692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70abcd-6dc9-4f3c-a214-89b0536a4040 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:07.911400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84531818-b480-40d4-b592-b31d2b67ad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:07.912029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84531818-b480-40d4-b592-b31d2b67ad7f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:07.912332 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84531818-b480-40d4-b592-b31d2b67ad7f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:07.912783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84531818-b480-40d4-b592-b31d2b67ad7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:07.923155 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84531818-b480-40d4-b592-b31d2b67ad7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-84531818-b480-40d4-b592-b31d2b67ad7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:07.928061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:07.928926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:07.929696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 25/49] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:07.935172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b8370-4be5-4161-a053-8bfe09e27903 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:07.996575 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:08.041871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b8370-4be5-4161-a053-8bfe09e27903 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:08.075597 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a419b-4c09-4d0d-a751-231a78ca9ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:08.076249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a419b-4c09-4d0d-a751-231a78ca9ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.076527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a419b-4c09-4d0d-a751-231a78ca9ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.076796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a419b-4c09-4d0d-a751-231a78ca9ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.077459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a419b-4c09-4d0d-a751-231a78ca9ac9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:08.077763 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a419b-4c09-4d0d-a751-231a78ca9ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:08.079145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a419b-4c09-4d0d-a751-231a78ca9ac9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:08.085673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebfb24-0c16-4ad7-b463-da90293838db None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.085957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebfb24-0c16-4ad7-b463-da90293838db None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.086231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebfb24-0c16-4ad7-b463-da90293838db None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.087555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 26/50] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:08.092612 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 25/51] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:08.092768 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ee7f-a9a9-4cbb-b411-ba3c12336ad9 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.092894 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ee7f-a9a9-4cbb-b411-ba3c12336ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.093168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ee7f-a9a9-4cbb-b411-ba3c12336ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.098112 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a419b-4c09-4d0d-a751-231a78ca9ac9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:08.112786 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1ad9ee7f-a9a9-4cbb-b411-ba3c12336ad9 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:08.114319 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1ad9ee7f-a9a9-4cbb-b411-ba3c12336ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:08.184612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 27/52] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:08.303562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a419b-4c09-4d0d-a751-231a78ca9ac9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:08.320273 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:08.338164 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b98e1-c3b4-45f8-9256-48cac59c5776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:08.338805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b98e1-c3b4-45f8-9256-48cac59c5776 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.339081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b98e1-c3b4-45f8-9256-48cac59c5776 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.339354 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b98e1-c3b4-45f8-9256-48cac59c5776 None admin] PATH_INFO: `/v3/users/98027de25a1b4edcab7ee4843ee0a448` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.340759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b98e1-c3b4-45f8-9256-48cac59c5776 None admin] RBAC: Authorizing `identity:get_user(user_id=98027de25a1b4edcab7ee4843ee0a448)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:08.342202 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b98e1-c3b4-45f8-9256-48cac59c5776 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:08.343783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:08 2022] GET /identity/v3/users/98027de25a1b4edcab7ee4843ee0a448 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:08.349501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9ee7f-a9a9-4cbb-b411-ba3c12336ad9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:08.437426 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:08.448317 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b98e1-c3b4-45f8-9256-48cac59c5776 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:08.459358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9ee7f-a9a9-4cbb-b411-ba3c12336ad9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:08.496671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e4e6b-6507-44b5-8061-ea4fce3a1c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:08.497301 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e4e6b-6507-44b5-8061-ea4fce3a1c07 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.497578 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e4e6b-6507-44b5-8061-ea4fce3a1c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.497907 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e4e6b-6507-44b5-8061-ea4fce3a1c07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.498987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e4e6b-6507-44b5-8061-ea4fce3a1c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:08.500485 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e4e6b-6507-44b5-8061-ea4fce3a1c07 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:08.502101 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 28/54] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:08.507921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e4e6b-6507-44b5-8061-ea4fce3a1c07 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:08.554392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b98e1-c3b4-45f8-9256-48cac59c5776 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:08.587273 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e9ce-6953-45d5-afcd-9e253422ec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:08.587910 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e9ce-6953-45d5-afcd-9e253422ec83 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.588216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e9ce-6953-45d5-afcd-9e253422ec83 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.588489 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e9ce-6953-45d5-afcd-9e253422ec83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.589595 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604e9ce-6953-45d5-afcd-9e253422ec83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:08.591040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604e9ce-6953-45d5-afcd-9e253422ec83 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:08.592631 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:08.598451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e9ce-6953-45d5-afcd-9e253422ec83 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:08.606287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e4e6b-6507-44b5-8061-ea4fce3a1c07 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:08.639843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ca33c-c26a-4bcb-964b-f0e1eea02a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:08.640474 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ca33c-c26a-4bcb-964b-f0e1eea02a7b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.640730 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ca33c-c26a-4bcb-964b-f0e1eea02a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.640999 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ca33c-c26a-4bcb-964b-f0e1eea02a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.641750 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ca33c-c26a-4bcb-964b-f0e1eea02a7b None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.domain.id=default, user.id=98027de25a1b4edcab7ee4843ee0a448) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:08.642021 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ca33c-c26a-4bcb-964b-f0e1eea02a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:08.643477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ca33c-c26a-4bcb-964b-f0e1eea02a7b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:08.649478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 29/56] 10.222.0.43 () {56 vars in 1322 bytes} [Sun Oct 9 00:42:08 2022] GET /identity/v3/role_assignments?user.id=98027de25a1b4edcab7ee4843ee0a448&scope.domain.id=default&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:08.653835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:08.702503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e9ce-6953-45d5-afcd-9e253422ec83 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:08.741486 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98676ad4-e5d7-4259-b65e-0ec1df87b3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:08.742150 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676ad4-e5d7-4259-b65e-0ec1df87b3c7 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.742432 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676ad4-e5d7-4259-b65e-0ec1df87b3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.742707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676ad4-e5d7-4259-b65e-0ec1df87b3c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.743381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676ad4-e5d7-4259-b65e-0ec1df87b3c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:08.744894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676ad4-e5d7-4259-b65e-0ec1df87b3c7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:08.777493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 28/57] 10.222.0.43 () {60 vars in 1140 bytes} [Sun Oct 9 00:42:08 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:42:10.910146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466e46-ea19-41e1-b67b-6266dd493a46 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.911070 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466e46-ea19-41e1-b67b-6266dd493a46 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.911070 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466e46-ea19-41e1-b67b-6266dd493a46 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.913263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 30/58] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:10.919548 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d316ff6-7144-4d2b-b3eb-27aab137c504 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.919971 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d316ff6-7144-4d2b-b3eb-27aab137c504 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.920194 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d316ff6-7144-4d2b-b3eb-27aab137c504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.949058 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-5d316ff6-7144-4d2b-b3eb-27aab137c504 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:10.950339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-5d316ff6-7144-4d2b-b3eb-27aab137c504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:11.018811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 29/59] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:11.285067 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06466e46-ea19-41e1-b67b-6266dd493a46 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:11.308625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:11.403378 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06466e46-ea19-41e1-b67b-6266dd493a46 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:11.440196 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f20b93-0aff-4d8e-8442-6e83cb0dbe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:11.440820 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f20b93-0aff-4d8e-8442-6e83cb0dbe45 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:11.441105 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f20b93-0aff-4d8e-8442-6e83cb0dbe45 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:11.441382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f20b93-0aff-4d8e-8442-6e83cb0dbe45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:11.442482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f20b93-0aff-4d8e-8442-6e83cb0dbe45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:11.444089 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f20b93-0aff-4d8e-8442-6e83cb0dbe45 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:11.445851 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 31/60] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:11.451649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d316ff6-7144-4d2b-b3eb-27aab137c504 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:11.487109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:11.572473 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d316ff6-7144-4d2b-b3eb-27aab137c504 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:11.608060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa0b2a-7cb6-4057-89f5-d7b0bdd92b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:11.608685 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa0b2a-7cb6-4057-89f5-d7b0bdd92b27 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:11.608964 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa0b2a-7cb6-4057-89f5-d7b0bdd92b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:11.609234 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa0b2a-7cb6-4057-89f5-d7b0bdd92b27 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:11.609881 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa0b2a-7cb6-4057-89f5-d7b0bdd92b27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:11.611340 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa0b2a-7cb6-4057-89f5-d7b0bdd92b27 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:11.644546 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 30/61] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:11 2022] POST /identity/v3/users => generated 275 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:15.046505 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1668526-f6ff-4082-9fca-a250b35246d0 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.047504 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1668526-f6ff-4082-9fca-a250b35246d0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.048024 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1668526-f6ff-4082-9fca-a250b35246d0 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.049880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 32/62] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:15.055462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eebdba-02ea-4763-90fe-8edb0f29206d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.056339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eebdba-02ea-4763-90fe-8edb0f29206d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.056813 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eebdba-02ea-4763-90fe-8edb0f29206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.085321 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-40eebdba-02ea-4763-90fe-8edb0f29206d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:15.086563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-40eebdba-02ea-4763-90fe-8edb0f29206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:15.182842 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 31/63] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:15.211621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d76356-cd60-44d1-a59a-cd11f2e424d5 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.212286 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d76356-cd60-44d1-a59a-cd11f2e424d5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.212789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d76356-cd60-44d1-a59a-cd11f2e424d5 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.214437 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 33/64] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:15.220569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dce5a0-f717-452e-bf3d-56bde4d81ad5 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.220892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dce5a0-f717-452e-bf3d-56bde4d81ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.221217 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dce5a0-f717-452e-bf3d-56bde4d81ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.222891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ae62f-ac67-4811-8bf6-359336d89301 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.223172 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ae62f-ac67-4811-8bf6-359336d89301 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.223657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ae62f-ac67-4811-8bf6-359336d89301 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.225405 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 34/65] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:15.231432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aa9ef-b7e5-4311-a0cb-ddd14dc3f945 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.232998 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aa9ef-b7e5-4311-a0cb-ddd14dc3f945 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.233533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aa9ef-b7e5-4311-a0cb-ddd14dc3f945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.247864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-14dce5a0-f717-452e-bf3d-56bde4d81ad5 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:15.249100 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-14dce5a0-f717-452e-bf3d-56bde4d81ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:15.269088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bb1aa9ef-b7e5-4311-a0cb-ddd14dc3f945 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:15.270269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bb1aa9ef-b7e5-4311-a0cb-ddd14dc3f945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:15.292411 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.368279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 32/66] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:15.369468 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874184a-ba5d-4aad-abd9-9773524f50a5 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.369753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874184a-ba5d-4aad-abd9-9773524f50a5 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.370026 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874184a-ba5d-4aad-abd9-9773524f50a5 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.371797 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 33/67] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:15.377218 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664f4e1-d75a-4526-bf58-990729429eb7 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.377881 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664f4e1-d75a-4526-bf58-990729429eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.378709 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664f4e1-d75a-4526-bf58-990729429eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.390126 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 35/68] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:15.402124 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-c664f4e1-d75a-4526-bf58-990729429eb7 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:15.403312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-c664f4e1-d75a-4526-bf58-990729429eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:15.486355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 34/69] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:15.488634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1aa9ef-b7e5-4311-a0cb-ddd14dc3f945 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.521957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.636997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1aa9ef-b7e5-4311-a0cb-ddd14dc3f945 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.678076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94810356-8e48-40d6-8670-2b6a080e5156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.678855 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810356-8e48-40d6-8670-2b6a080e5156 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.679135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810356-8e48-40d6-8670-2b6a080e5156 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.679405 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810356-8e48-40d6-8670-2b6a080e5156 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.691192 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94810356-8e48-40d6-8670-2b6a080e5156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-94810356-8e48-40d6-8670-2b6a080e5156 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:15.696401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:15.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:15.698120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 36/70] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:15.703525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664f4e1-d75a-4526-bf58-990729429eb7 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.711449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94810356-8e48-40d6-8670-2b6a080e5156 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.811450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.813135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.835583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664f4e1-d75a-4526-bf58-990729429eb7 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.840496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94810356-8e48-40d6-8670-2b6a080e5156 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.871316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d348760-11b7-42fe-8dc9-5026cad8d705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.871935 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d348760-11b7-42fe-8dc9-5026cad8d705 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.872474 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d348760-11b7-42fe-8dc9-5026cad8d705 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.872756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d348760-11b7-42fe-8dc9-5026cad8d705 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.873418 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d348760-11b7-42fe-8dc9-5026cad8d705 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:15.873724 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d348760-11b7-42fe-8dc9-5026cad8d705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:15.875116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d348760-11b7-42fe-8dc9-5026cad8d705 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:15.876546 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90146e1-8519-4f9e-a739-7be4a9d03ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.877182 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90146e1-8519-4f9e-a739-7be4a9d03ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.877459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90146e1-8519-4f9e-a739-7be4a9d03ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.877728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90146e1-8519-4f9e-a739-7be4a9d03ac6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.884087 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:15.884798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d348760-11b7-42fe-8dc9-5026cad8d705 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.888899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90146e1-8519-4f9e-a739-7be4a9d03ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e90146e1-8519-4f9e-a739-7be4a9d03ac6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:15.893647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:15.894577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:15.895361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:15.896025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5210deb-dab8-474a-af6a-614cbb36eed7 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.897103 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5210deb-dab8-474a-af6a-614cbb36eed7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.897103 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5210deb-dab8-474a-af6a-614cbb36eed7 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.898419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 38/73] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:15.899128 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5210deb-dab8-474a-af6a-614cbb36eed7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.988531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d348760-11b7-42fe-8dc9-5026cad8d705 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.997318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5210deb-dab8-474a-af6a-614cbb36eed7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.021895 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a2db4-c2d9-43ff-b57e-c565c20f80c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.022762 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a2db4-c2d9-43ff-b57e-c565c20f80c3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a2db4-c2d9-43ff-b57e-c565c20f80c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.023324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a2db4-c2d9-43ff-b57e-c565c20f80c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.030651 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b53efa-4b63-438a-aa37-58001d424961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.031273 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53efa-4b63-438a-aa37-58001d424961 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.031545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53efa-4b63-438a-aa37-58001d424961 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.031812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53efa-4b63-438a-aa37-58001d424961 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.034878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.035041 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a2db4-c2d9-43ff-b57e-c565c20f80c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-cb5a2db4-c2d9-43ff-b57e-c565c20f80c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:16.041469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:16.042395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:16.043172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 36/74] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:16.043841 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b53efa-4b63-438a-aa37-58001d424961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:16.048219 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a2db4-c2d9-43ff-b57e-c565c20f80c3 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-13b53efa-4b63-438a-aa37-58001d424961 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:16.048351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:16.049535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 39/75] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:16.050300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b53efa-4b63-438a-aa37-58001d424961 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.054190 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.152000 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a2db4-c2d9-43ff-b57e-c565c20f80c3 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.153759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b53efa-4b63-438a-aa37-58001d424961 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.185428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeeb1e-de53-454c-a213-19f552d98bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.186060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeeb1e-de53-454c-a213-19f552d98bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.186340 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeeb1e-de53-454c-a213-19f552d98bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.186496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415615f-56fe-496a-b46e-1aad30535884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.186622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeeb1e-de53-454c-a213-19f552d98bc7 None admin] PATH_INFO: `/v3/users/98027de25a1b4edcab7ee4843ee0a448` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.187087 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415615f-56fe-496a-b46e-1aad30535884 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.187365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415615f-56fe-496a-b46e-1aad30535884 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.187635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415615f-56fe-496a-b46e-1aad30535884 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.187787 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeeb1e-de53-454c-a213-19f552d98bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=98027de25a1b4edcab7ee4843ee0a448)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.188327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415615f-56fe-496a-b46e-1aad30535884 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:16.188629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415615f-56fe-496a-b46e-1aad30535884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.189301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeeb1e-de53-454c-a213-19f552d98bc7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.190000 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415615f-56fe-496a-b46e-1aad30535884 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.191056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 37/76] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/users/98027de25a1b4edcab7ee4843ee0a448 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:16.191945 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd527c31-b160-4aad-aee3-391200a6a125 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.192446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd527c31-b160-4aad-aee3-391200a6a125 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.192533 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd527c31-b160-4aad-aee3-391200a6a125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.198637 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 40/77] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:16.199472 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415615f-56fe-496a-b46e-1aad30535884 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.210533 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-bd527c31-b160-4aad-aee3-391200a6a125 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:16.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-bd527c31-b160-4aad-aee3-391200a6a125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:16.260263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.278393 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 38/78] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:16.279225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd527c31-b160-4aad-aee3-391200a6a125 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.288438 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.304687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415615f-56fe-496a-b46e-1aad30535884 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.341056 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083151a-9578-4899-a6b6-cde47ef8edf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.341884 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083151a-9578-4899-a6b6-cde47ef8edf7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083151a-9578-4899-a6b6-cde47ef8edf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.342595 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083151a-9578-4899-a6b6-cde47ef8edf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.343272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083151a-9578-4899-a6b6-cde47ef8edf7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:16.343562 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083151a-9578-4899-a6b6-cde47ef8edf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.344999 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083151a-9578-4899-a6b6-cde47ef8edf7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.357583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 41/79] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:16.357583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083151a-9578-4899-a6b6-cde47ef8edf7 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.389959 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd527c31-b160-4aad-aee3-391200a6a125 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.425038 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37538087-07e8-4725-900a-9acae1919762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.426300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538087-07e8-4725-900a-9acae1919762 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538087-07e8-4725-900a-9acae1919762 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.426845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538087-07e8-4725-900a-9acae1919762 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.427507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37538087-07e8-4725-900a-9acae1919762 None admin] RBAC: Adding query filter params (name=member) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:16.427805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37538087-07e8-4725-900a-9acae1919762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.429301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37538087-07e8-4725-900a-9acae1919762 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.437960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 39/80] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:16.438756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37538087-07e8-4725-900a-9acae1919762 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.468628 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083151a-9578-4899-a6b6-cde47ef8edf7 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.489926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.502544 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.507345 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b0d79-efe1-4c73-bebf-828249e46f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.508297 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b0d79-efe1-4c73-bebf-828249e46f3b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.508583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b0d79-efe1-4c73-bebf-828249e46f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b0d79-efe1-4c73-bebf-828249e46f3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.541543 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37538087-07e8-4725-900a-9acae1919762 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.573788 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de8aca-d7a8-441c-9107-067e1eb5b03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.574413 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8aca-d7a8-441c-9107-067e1eb5b03a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.574684 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8aca-d7a8-441c-9107-067e1eb5b03a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.574954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8aca-d7a8-441c-9107-067e1eb5b03a None admin] PATH_INFO: `/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.581493 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b0d79-efe1-4c73-bebf-828249e46f3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.583009 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b0d79-efe1-4c73-bebf-828249e46f3b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.589605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de8aca-d7a8-441c-9107-067e1eb5b03a None admin] RBAC: Authorizing `identity:get_user(user_id=6f02ba7b97474cd7bb2e02b3f9f8106e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.591019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de8aca-d7a8-441c-9107-067e1eb5b03a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.592673 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 40/81] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:16.593581 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de8aca-d7a8-441c-9107-067e1eb5b03a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.685522 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 42/82] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:16.685522 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b0d79-efe1-4c73-bebf-828249e46f3b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.694839 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de8aca-d7a8-441c-9107-067e1eb5b03a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.703243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.717631 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.730538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad4758-66c0-410b-9bba-0c93f6262564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.731174 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad4758-66c0-410b-9bba-0c93f6262564 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.731454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad4758-66c0-410b-9bba-0c93f6262564 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.731726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad4758-66c0-410b-9bba-0c93f6262564 None admin] PATH_INFO: `/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.732903 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad4758-66c0-410b-9bba-0c93f6262564 None admin] RBAC: Authorizing `identity:get_user(user_id=6f02ba7b97474cd7bb2e02b3f9f8106e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.734364 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad4758-66c0-410b-9bba-0c93f6262564 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.735978 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 41/83] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:16.736753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad4758-66c0-410b-9bba-0c93f6262564 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.785887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b0d79-efe1-4c73-bebf-828249e46f3b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.822344 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd01fa-8a2b-447a-87d6-ef284086dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.822982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd01fa-8a2b-447a-87d6-ef284086dba1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.823265 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd01fa-8a2b-447a-87d6-ef284086dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.823599 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd01fa-8a2b-447a-87d6-ef284086dba1 None admin] PATH_INFO: `/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.824815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd01fa-8a2b-447a-87d6-ef284086dba1 None admin] RBAC: Authorizing `identity:get_user(user_id=6f02ba7b97474cd7bb2e02b3f9f8106e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.826296 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd01fa-8a2b-447a-87d6-ef284086dba1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.828070 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 43/84] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:16.828763 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd01fa-8a2b-447a-87d6-ef284086dba1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.842083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad4758-66c0-410b-9bba-0c93f6262564 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.877709 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238d9f0-eb19-491b-b636-41f9c65669d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.878805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238d9f0-eb19-491b-b636-41f9c65669d3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.879175 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238d9f0-eb19-491b-b636-41f9c65669d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.879487 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238d9f0-eb19-491b-b636-41f9c65669d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.881203 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238d9f0-eb19-491b-b636-41f9c65669d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.883809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238d9f0-eb19-491b-b636-41f9c65669d3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.886190 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 42/85] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:16.886946 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238d9f0-eb19-491b-b636-41f9c65669d3 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.925799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.938263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd01fa-8a2b-447a-87d6-ef284086dba1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.948966 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.972730 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d383cd-c7eb-452e-bcb2-273958eedede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.973341 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d383cd-c7eb-452e-bcb2-273958eedede None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.973626 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d383cd-c7eb-452e-bcb2-273958eedede None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.973887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d383cd-c7eb-452e-bcb2-273958eedede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.990036 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238d9f0-eb19-491b-b636-41f9c65669d3 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.022770 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a8656-1985-44ae-b4a0-f287fe979dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.023395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8656-1985-44ae-b4a0-f287fe979dbe None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.023675 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8656-1985-44ae-b4a0-f287fe979dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.023943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a8656-1985-44ae-b4a0-f287fe979dbe None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.025126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a8656-1985-44ae-b4a0-f287fe979dbe None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.026600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a8656-1985-44ae-b4a0-f287fe979dbe None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.028274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 43/86] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:17.029029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a8656-1985-44ae-b4a0-f287fe979dbe None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.042306 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d383cd-c7eb-452e-bcb2-273958eedede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.043809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d383cd-c7eb-452e-bcb2-273958eedede None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.125008 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a8656-1985-44ae-b4a0-f287fe979dbe None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.129093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:17.142642 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 44/87] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:17.143562 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d383cd-c7eb-452e-bcb2-273958eedede None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.152500 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:17.160354 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715b6ff-aef1-457a-9cf2-0efeeaf73071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.160972 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715b6ff-aef1-457a-9cf2-0efeeaf73071 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.161244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715b6ff-aef1-457a-9cf2-0efeeaf73071 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.161513 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715b6ff-aef1-457a-9cf2-0efeeaf73071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.228034 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715b6ff-aef1-457a-9cf2-0efeeaf73071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.229515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715b6ff-aef1-457a-9cf2-0efeeaf73071 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.240502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d383cd-c7eb-452e-bcb2-273958eedede None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.274495 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401fe07-7c2d-4eee-ae5d-1c46bd805a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.275111 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401fe07-7c2d-4eee-ae5d-1c46bd805a21 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.275389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401fe07-7c2d-4eee-ae5d-1c46bd805a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.275665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401fe07-7c2d-4eee-ae5d-1c46bd805a21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.326474 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 44/88] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:17.327271 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715b6ff-aef1-457a-9cf2-0efeeaf73071 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.328398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:17.341980 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401fe07-7c2d-4eee-ae5d-1c46bd805a21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.343456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401fe07-7c2d-4eee-ae5d-1c46bd805a21 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.356885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:17.434239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715b6ff-aef1-457a-9cf2-0efeeaf73071 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.439845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 45/89] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:17.440710 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401fe07-7c2d-4eee-ae5d-1c46bd805a21 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.468428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cd2a7-5821-474c-aa8d-3c37ebd4f6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.469046 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cd2a7-5821-474c-aa8d-3c37ebd4f6b0 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.469325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cd2a7-5821-474c-aa8d-3c37ebd4f6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.469597 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cd2a7-5821-474c-aa8d-3c37ebd4f6b0 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.470252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cd2a7-5821-474c-aa8d-3c37ebd4f6b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.471705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cd2a7-5821-474c-aa8d-3c37ebd4f6b0 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.493240 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 45/90] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:17 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:17.497016 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cd2a7-5821-474c-aa8d-3c37ebd4f6b0 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.537536 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:17.552404 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401fe07-7c2d-4eee-ae5d-1c46bd805a21 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.593099 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dabc5-daf7-4b16-81c6-1a21d4c3e60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.593726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dabc5-daf7-4b16-81c6-1a21d4c3e60c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.594037 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dabc5-daf7-4b16-81c6-1a21d4c3e60c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.594312 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dabc5-daf7-4b16-81c6-1a21d4c3e60c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.595074 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dabc5-daf7-4b16-81c6-1a21d4c3e60c None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf, user.id=98027de25a1b4edcab7ee4843ee0a448) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:17.595384 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dabc5-daf7-4b16-81c6-1a21d4c3e60c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.597523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dabc5-daf7-4b16-81c6-1a21d4c3e60c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.604506 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:17.605078 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 46/91] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:17 2022] GET /identity/v3/role_assignments?user.id=98027de25a1b4edcab7ee4843ee0a448&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:17.605744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dabc5-daf7-4b16-81c6-1a21d4c3e60c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.644095 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cd2a7-5821-474c-aa8d-3c37ebd4f6b0 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.687745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94dfa1-a4de-4974-9973-275dc7832391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.688844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94dfa1-a4de-4974-9973-275dc7832391 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.689334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94dfa1-a4de-4974-9973-275dc7832391 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.689617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94dfa1-a4de-4974-9973-275dc7832391 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.690915 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94dfa1-a4de-4974-9973-275dc7832391 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94dfa1-a4de-4974-9973-275dc7832391 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.694995 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 46/92] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:17 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:17.695844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94dfa1-a4de-4974-9973-275dc7832391 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.758718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dabc5-daf7-4b16-81c6-1a21d4c3e60c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.807349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85f736-4f94-4599-a036-a18cc8429603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.808457 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85f736-4f94-4599-a036-a18cc8429603 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.808914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85f736-4f94-4599-a036-a18cc8429603 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.809191 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85f736-4f94-4599-a036-a18cc8429603 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.810368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85f736-4f94-4599-a036-a18cc8429603 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.811855 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85f736-4f94-4599-a036-a18cc8429603 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.815266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 47/93] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:17 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:17.815266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85f736-4f94-4599-a036-a18cc8429603 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.833015 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94dfa1-a4de-4974-9973-275dc7832391 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.845264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:17.884709 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4b2fd-488b-4fea-ad69-779ecbb8989c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.885628 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b2fd-488b-4fea-ad69-779ecbb8989c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.886104 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b2fd-488b-4fea-ad69-779ecbb8989c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.886522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b2fd-488b-4fea-ad69-779ecbb8989c None admin] PATH_INFO: `/v3/projects/1d03b1a2be954e14ae3a2cc351018c65` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.887872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4b2fd-488b-4fea-ad69-779ecbb8989c None admin] RBAC: Authorizing `identity:get_project(project_id=1d03b1a2be954e14ae3a2cc351018c65)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.889518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4b2fd-488b-4fea-ad69-779ecbb8989c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.891363 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 47/94] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:17 2022] GET /identity/v3/projects/1d03b1a2be954e14ae3a2cc351018c65 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:17.892693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4b2fd-488b-4fea-ad69-779ecbb8989c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.914883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:17.947371 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85f736-4f94-4599-a036-a18cc8429603 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.995971 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcee25-d5d0-4dc1-bd01-c38c031e6278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.996767 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcee25-d5d0-4dc1-bd01-c38c031e6278 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.997393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcee25-d5d0-4dc1-bd01-c38c031e6278 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.997763 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcee25-d5d0-4dc1-bd01-c38c031e6278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.998659 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcee25-d5d0-4dc1-bd01-c38c031e6278 None admin] RBAC: Adding query filter params (role.id=fa4a34a109e44660bbce4320a4c9a366, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf, user.id=6f02ba7b97474cd7bb2e02b3f9f8106e) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:17.999994 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcee25-d5d0-4dc1-bd01-c38c031e6278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:18.000881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcee25-d5d0-4dc1-bd01-c38c031e6278 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:18.010579 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 48/95] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:17 2022] GET /identity/v3/role_assignments?user.id=6f02ba7b97474cd7bb2e02b3f9f8106e&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:18.010579 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcee25-d5d0-4dc1-bd01-c38c031e6278 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:18.019578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4b2fd-488b-4fea-ad69-779ecbb8989c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:18.065782 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417692-6a92-43f7-80f3-7ca9c76d8b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:18.066797 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417692-6a92-43f7-80f3-7ca9c76d8b5d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:18.068439 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417692-6a92-43f7-80f3-7ca9c76d8b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:18.069056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417692-6a92-43f7-80f3-7ca9c76d8b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:18.073717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417692-6a92-43f7-80f3-7ca9c76d8b5d None admin] RBAC: Adding query filter params (role.id=d796a9636e044b848ecdc0f80ee9443d, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf, user.id=6f02ba7b97474cd7bb2e02b3f9f8106e) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:18.074101 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417692-6a92-43f7-80f3-7ca9c76d8b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:18.076094 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417692-6a92-43f7-80f3-7ca9c76d8b5d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:18.098441 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 48/96] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:17 2022] GET /identity/v3/role_assignments?user.id=6f02ba7b97474cd7bb2e02b3f9f8106e&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=d796a9636e044b848ecdc0f80ee9443d => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:18.162518 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:18.192456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcee25-d5d0-4dc1-bd01-c38c031e6278 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:18.241186 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732899de-0ce8-4fa5-a3c6-2bb9c251d111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:18.242293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732899de-0ce8-4fa5-a3c6-2bb9c251d111 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:18.242753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732899de-0ce8-4fa5-a3c6-2bb9c251d111 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:18.243209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732899de-0ce8-4fa5-a3c6-2bb9c251d111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:18.244135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732899de-0ce8-4fa5-a3c6-2bb9c251d111 None admin] RBAC: Adding query filter params (role.id=fa4a34a109e44660bbce4320a4c9a366, scope.project.id=1d03b1a2be954e14ae3a2cc351018c65, user.id=6f02ba7b97474cd7bb2e02b3f9f8106e) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:18.244649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732899de-0ce8-4fa5-a3c6-2bb9c251d111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:18.246319 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732899de-0ce8-4fa5-a3c6-2bb9c251d111 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:18.252739 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 49/97] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:18 2022] GET /identity/v3/role_assignments?user.id=6f02ba7b97474cd7bb2e02b3f9f8106e&scope.project.id=1d03b1a2be954e14ae3a2cc351018c65&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:20.756344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff052de-02a5-4e22-9841-bd05cc794a2e None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.756960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff052de-02a5-4e22-9841-bd05cc794a2e None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.756960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff052de-02a5-4e22-9841-bd05cc794a2e None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.758544 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 49/98] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:20.770294 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5beb8e-f3eb-407a-88f9-2920d0111e75 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.771257 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5beb8e-f3eb-407a-88f9-2920d0111e75 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.771865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5beb8e-f3eb-407a-88f9-2920d0111e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.800929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8d5beb8e-f3eb-407a-88f9-2920d0111e75 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:20.802142 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8d5beb8e-f3eb-407a-88f9-2920d0111e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:20.857279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56de39-b989-4a76-b04b-0b10851ba8bc None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.857651 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56de39-b989-4a76-b04b-0b10851ba8bc None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.857850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56de39-b989-4a76-b04b-0b10851ba8bc None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.859278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 50/99] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:20.867371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facbe3b-1cc6-4f92-9fdd-c16b07f9c5b8 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.867646 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facbe3b-1cc6-4f92-9fdd-c16b07f9c5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.867916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facbe3b-1cc6-4f92-9fdd-c16b07f9c5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.899970 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-7facbe3b-1cc6-4f92-9fdd-c16b07f9c5b8 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:20.901181 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-7facbe3b-1cc6-4f92-9fdd-c16b07f9c5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:20.927568 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 50/100] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:21.014767 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 51/101] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:21.070534 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdb52a-848d-4f4a-8c1f-2129f7da69a4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.071189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdb52a-848d-4f4a-8c1f-2129f7da69a4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.071657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdb52a-848d-4f4a-8c1f-2129f7da69a4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.073263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 51/102] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:21.078705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8bc5c-703d-4374-a60b-ce9a23bbb7e8 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.078992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8bc5c-703d-4374-a60b-ce9a23bbb7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.079261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8bc5c-703d-4374-a60b-ce9a23bbb7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.105948 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-2da8bc5c-703d-4374-a60b-ce9a23bbb7e8 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:21.107120 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-2da8bc5c-703d-4374-a60b-ce9a23bbb7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:21.116113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:21.194789 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 52/103] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:21.229277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d4e7-6374-46ec-a39a-43fea5fcad87 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.229913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d4e7-6374-46ec-a39a-43fea5fcad87 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.230382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d4e7-6374-46ec-a39a-43fea5fcad87 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.231943 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 52/104] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:21.245716 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a2c05-8260-470b-bfff-067009b7698d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.246000 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a2c05-8260-470b-bfff-067009b7698d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.246275 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a2c05-8260-470b-bfff-067009b7698d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.269271 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-9d4a2c05-8260-470b-bfff-067009b7698d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:21.270363 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-9d4a2c05-8260-470b-bfff-067009b7698d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:21.352537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 53/105] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:21.358103 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b111f2d-7741-4807-9c54-dd0ce668eeda None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.358733 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b111f2d-7741-4807-9c54-dd0ce668eeda None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.359219 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b111f2d-7741-4807-9c54-dd0ce668eeda None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.360841 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 53/106] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:21.366250 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eebf5e-e3d7-4a0a-a16e-f3572e55ebbc None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.366534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eebf5e-e3d7-4a0a-a16e-f3572e55ebbc None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.366811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eebf5e-e3d7-4a0a-a16e-f3572e55ebbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.388256 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b111f2d-7741-4807-9c54-dd0ce668eeda None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.397219 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-c9eebf5e-e3d7-4a0a-a16e-f3572e55ebbc None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:21.398559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-c9eebf5e-e3d7-4a0a-a16e-f3572e55ebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:21.466750 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 54/107] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:21.473121 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eebf5e-e3d7-4a0a-a16e-f3572e55ebbc None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.487539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:21.598414 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:21.634899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eebf5e-e3d7-4a0a-a16e-f3572e55ebbc None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.637557 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b111f2d-7741-4807-9c54-dd0ce668eeda None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc765-96e0-473d-8e8b-89c64fc0b77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:21.688657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc765-96e0-473d-8e8b-89c64fc0b77c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6c567-0495-4025-9d65-7dfb54f54740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:21.689230 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc765-96e0-473d-8e8b-89c64fc0b77c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.689632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc765-96e0-473d-8e8b-89c64fc0b77c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.689800 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c567-0495-4025-9d65-7dfb54f54740 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.690145 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c567-0495-4025-9d65-7dfb54f54740 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.690489 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c567-0495-4025-9d65-7dfb54f54740 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc765-96e0-473d-8e8b-89c64fc0b77c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:21.702222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6c567-0495-4025-9d65-7dfb54f54740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-48ffc765-96e0-473d-8e8b-89c64fc0b77c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:21.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:21.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:21.707913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7aa6c567-0495-4025-9d65-7dfb54f54740 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:21.708558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:21.709443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:21.710255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:21.710863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 55/108] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:21.711010 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 54/109] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:21.711010 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7d9df-3480-4e72-94a2-06beb8ebf30c None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.711010 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7d9df-3480-4e72-94a2-06beb8ebf30c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.711010 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7d9df-3480-4e72-94a2-06beb8ebf30c None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.716347 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 55/110] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:21.716549 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc765-96e0-473d-8e8b-89c64fc0b77c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.717323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7d9df-3480-4e72-94a2-06beb8ebf30c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.793626 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:21.832633 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7d9df-3480-4e72-94a2-06beb8ebf30c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.838993 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc765-96e0-473d-8e8b-89c64fc0b77c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.866728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a916d86-4227-4356-a88c-331695764588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:21.867289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916d86-4227-4356-a88c-331695764588 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.867562 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916d86-4227-4356-a88c-331695764588 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.867832 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916d86-4227-4356-a88c-331695764588 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.868978 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a916d86-4227-4356-a88c-331695764588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:21.870430 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a916d86-4227-4356-a88c-331695764588 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:21.872186 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 56/111] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:21.873234 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f680c6-cb1e-4bb5-82d7-ce50dcbfa1fb None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.873514 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f680c6-cb1e-4bb5-82d7-ce50dcbfa1fb None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.873778 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f680c6-cb1e-4bb5-82d7-ce50dcbfa1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.876748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de142a8-f0b9-421c-9fa1-f73fd01853ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:21.877399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de142a8-f0b9-421c-9fa1-f73fd01853ff None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.877673 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de142a8-f0b9-421c-9fa1-f73fd01853ff None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.877937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de142a8-f0b9-421c-9fa1-f73fd01853ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.886858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:21.889441 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de142a8-f0b9-421c-9fa1-f73fd01853ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:21.892486 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-24f680c6-cb1e-4bb5-82d7-ce50dcbfa1fb None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:21.893672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-24f680c6-cb1e-4bb5-82d7-ce50dcbfa1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-5de142a8-f0b9-421c-9fa1-f73fd01853ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:21.894455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:21.895520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:21.896512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 56/112] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:21.897705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de142a8-f0b9-421c-9fa1-f73fd01853ff None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.964172 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 57/113] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:21.968987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f680c6-cb1e-4bb5-82d7-ce50dcbfa1fb None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.997041 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de142a8-f0b9-421c-9fa1-f73fd01853ff None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.020424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.033869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a3c7-6458-4561-b8bb-ce83534620c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.034567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a3c7-6458-4561-b8bb-ce83534620c1 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.034846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a3c7-6458-4561-b8bb-ce83534620c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.035142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a3c7-6458-4561-b8bb-ce83534620c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.035813 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4a3c7-6458-4561-b8bb-ce83534620c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:22.036163 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4a3c7-6458-4561-b8bb-ce83534620c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.037538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4a3c7-6458-4561-b8bb-ce83534620c1 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.046395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 57/114] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:22.051672 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a3c7-6458-4561-b8bb-ce83534620c1 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.071521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f680c6-cb1e-4bb5-82d7-ce50dcbfa1fb None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.108458 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5e690-3158-4e0d-9599-28079dc70b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.109069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5e690-3158-4e0d-9599-28079dc70b33 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.109344 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5e690-3158-4e0d-9599-28079dc70b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.109612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5e690-3158-4e0d-9599-28079dc70b33 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.110262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5e690-3158-4e0d-9599-28079dc70b33 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:22.110558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5e690-3158-4e0d-9599-28079dc70b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.112013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5e690-3158-4e0d-9599-28079dc70b33 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.114498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.122122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 58/115] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:22.122831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5e690-3158-4e0d-9599-28079dc70b33 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.162845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a3c7-6458-4561-b8bb-ce83534620c1 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.196521 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f855b-6323-42b0-8e99-4d2eea6675ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.197461 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f855b-6323-42b0-8e99-4d2eea6675ab None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.197461 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f855b-6323-42b0-8e99-4d2eea6675ab None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.197713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f855b-6323-42b0-8e99-4d2eea6675ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.208298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f855b-6323-42b0-8e99-4d2eea6675ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-517f855b-6323-42b0-8e99-4d2eea6675ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:22.213748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:22.214607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:22.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 58/116] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:22.216374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f855b-6323-42b0-8e99-4d2eea6675ab None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.231753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5e690-3158-4e0d-9599-28079dc70b33 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.260702 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.265994 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d752-0f85-40ff-9321-055e22454954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.266603 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d752-0f85-40ff-9321-055e22454954 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.266882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d752-0f85-40ff-9321-055e22454954 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.267153 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d752-0f85-40ff-9321-055e22454954 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.267803 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527d752-0f85-40ff-9321-055e22454954 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.269384 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527d752-0f85-40ff-9321-055e22454954 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.296432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 59/117] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:42:22 2022] POST /identity/v3/projects => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:22.305224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d752-0f85-40ff-9321-055e22454954 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.317758 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f855b-6323-42b0-8e99-4d2eea6675ab None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.361958 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fe333-c531-44f0-a745-08ccc904b113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.362583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fe333-c531-44f0-a745-08ccc904b113 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.362855 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fe333-c531-44f0-a745-08ccc904b113 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.363464 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fe333-c531-44f0-a745-08ccc904b113 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.363571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.363785 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fe333-c531-44f0-a745-08ccc904b113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:22.364451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fe333-c531-44f0-a745-08ccc904b113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.365716 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fe333-c531-44f0-a745-08ccc904b113 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.376407 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 59/118] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:22.377114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fe333-c531-44f0-a745-08ccc904b113 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.424669 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d752-0f85-40ff-9321-055e22454954 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.462100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efee71-7b10-4cb8-9045-de5a093b1750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.462753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efee71-7b10-4cb8-9045-de5a093b1750 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.463045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efee71-7b10-4cb8-9045-de5a093b1750 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.463308 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efee71-7b10-4cb8-9045-de5a093b1750 None admin] PATH_INFO: `/v3/users/696ed37eab99417ab0a644847889af86` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.479768 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efee71-7b10-4cb8-9045-de5a093b1750 None admin] RBAC: Authorizing `identity:get_user(user_id=696ed37eab99417ab0a644847889af86)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.481289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efee71-7b10-4cb8-9045-de5a093b1750 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.483635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 60/119] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/users/696ed37eab99417ab0a644847889af86 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:22.483793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efee71-7b10-4cb8-9045-de5a093b1750 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.498573 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fe333-c531-44f0-a745-08ccc904b113 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.507270 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.535494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e28e0-aeac-445e-9ba7-b35f662b2b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.536169 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e28e0-aeac-445e-9ba7-b35f662b2b76 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.536451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e28e0-aeac-445e-9ba7-b35f662b2b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.536722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e28e0-aeac-445e-9ba7-b35f662b2b76 None admin] PATH_INFO: `/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.538004 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e28e0-aeac-445e-9ba7-b35f662b2b76 None admin] RBAC: Authorizing `identity:get_user(user_id=6f02ba7b97474cd7bb2e02b3f9f8106e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.539498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e28e0-aeac-445e-9ba7-b35f662b2b76 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.541194 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 60/120] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:22.541960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e28e0-aeac-445e-9ba7-b35f662b2b76 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.589134 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efee71-7b10-4cb8-9045-de5a093b1750 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.599480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.624841 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f81a13-a9f0-4706-8cf4-485081e181d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.625453 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81a13-a9f0-4706-8cf4-485081e181d5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.625731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81a13-a9f0-4706-8cf4-485081e181d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.626002 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81a13-a9f0-4706-8cf4-485081e181d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.626722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f81a13-a9f0-4706-8cf4-485081e181d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:22.626964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f81a13-a9f0-4706-8cf4-485081e181d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.628434 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f81a13-a9f0-4706-8cf4-485081e181d5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.639249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 61/121] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:22.639249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f81a13-a9f0-4706-8cf4-485081e181d5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.652957 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e28e0-aeac-445e-9ba7-b35f662b2b76 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.690166 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd64e5b-0fd6-4430-b2bf-1bc02bd7f0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.691083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64e5b-0fd6-4430-b2bf-1bc02bd7f0fe None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.691334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64e5b-0fd6-4430-b2bf-1bc02bd7f0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.691683 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64e5b-0fd6-4430-b2bf-1bc02bd7f0fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.702329 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd64e5b-0fd6-4430-b2bf-1bc02bd7f0fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-dcd64e5b-0fd6-4430-b2bf-1bc02bd7f0fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:22.707584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:22.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 61/122] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:22.709743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd64e5b-0fd6-4430-b2bf-1bc02bd7f0fe None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.750453 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f81a13-a9f0-4706-8cf4-485081e181d5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.753769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.789847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab51c7-cdba-42b7-a521-7a6070885af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.789847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab51c7-cdba-42b7-a521-7a6070885af3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.789847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab51c7-cdba-42b7-a521-7a6070885af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.789847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab51c7-cdba-42b7-a521-7a6070885af3 None admin] PATH_INFO: `/v3/users/98027de25a1b4edcab7ee4843ee0a448` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.790292 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab51c7-cdba-42b7-a521-7a6070885af3 None admin] RBAC: Authorizing `identity:get_user(user_id=98027de25a1b4edcab7ee4843ee0a448)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.791427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab51c7-cdba-42b7-a521-7a6070885af3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.793428 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 62/123] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/users/98027de25a1b4edcab7ee4843ee0a448 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:22.793922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab51c7-cdba-42b7-a521-7a6070885af3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.834488 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd64e5b-0fd6-4430-b2bf-1bc02bd7f0fe None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.844742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.874568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef9878-0f2f-4fde-8400-510f7b1b2641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.875693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef9878-0f2f-4fde-8400-510f7b1b2641 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.877043 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef9878-0f2f-4fde-8400-510f7b1b2641 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.877468 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef9878-0f2f-4fde-8400-510f7b1b2641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.907507 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab51c7-cdba-42b7-a521-7a6070885af3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.944169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad11c3-549b-4421-ac48-18ab55c688d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.944893 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad11c3-549b-4421-ac48-18ab55c688d5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.945174 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad11c3-549b-4421-ac48-18ab55c688d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.945455 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad11c3-549b-4421-ac48-18ab55c688d5 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.946589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad11c3-549b-4421-ac48-18ab55c688d5 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.948094 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad11c3-549b-4421-ac48-18ab55c688d5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.949744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 63/124] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:22.950510 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad11c3-549b-4421-ac48-18ab55c688d5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.952233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef9878-0f2f-4fde-8400-510f7b1b2641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.954106 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef9878-0f2f-4fde-8400-510f7b1b2641 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.988032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:23.061554 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 62/125] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:23.062372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef9878-0f2f-4fde-8400-510f7b1b2641 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:23.063936 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad11c3-549b-4421-ac48-18ab55c688d5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:23.072277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:23.101457 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d514de0-6d5c-4a74-abae-ef772956b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:23.102095 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d514de0-6d5c-4a74-abae-ef772956b38d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:23.102372 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d514de0-6d5c-4a74-abae-ef772956b38d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:23.102641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d514de0-6d5c-4a74-abae-ef772956b38d None admin] PATH_INFO: `/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:23.103763 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d514de0-6d5c-4a74-abae-ef772956b38d None admin] RBAC: Authorizing `identity:get_user(user_id=6f02ba7b97474cd7bb2e02b3f9f8106e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:23.105251 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d514de0-6d5c-4a74-abae-ef772956b38d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:23.106994 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 64/126] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:23.107657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d514de0-6d5c-4a74-abae-ef772956b38d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:23.180178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef9878-0f2f-4fde-8400-510f7b1b2641 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:23.211834 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d514de0-6d5c-4a74-abae-ef772956b38d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:23.223866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe7d7-82b5-451c-b60b-7b6060285b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:23.224824 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe7d7-82b5-451c-b60b-7b6060285b25 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:23.225136 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe7d7-82b5-451c-b60b-7b6060285b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:23.225586 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe7d7-82b5-451c-b60b-7b6060285b25 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:23.226579 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbe7d7-82b5-451c-b60b-7b6060285b25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:23.226889 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbe7d7-82b5-451c-b60b-7b6060285b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:23.228419 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbe7d7-82b5-451c-b60b-7b6060285b25 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:23.230529 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:23.244653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 63/127] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:23.245470 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe7d7-82b5-451c-b60b-7b6060285b25 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:23.253274 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9bfa8-083f-444e-b6f4-e9dd3d389a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:23.254150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9bfa8-083f-444e-b6f4-e9dd3d389a47 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:23.254431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9bfa8-083f-444e-b6f4-e9dd3d389a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:23.254708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9bfa8-083f-444e-b6f4-e9dd3d389a47 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:23.255835 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9bfa8-083f-444e-b6f4-e9dd3d389a47 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:23.257542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9bfa8-083f-444e-b6f4-e9dd3d389a47 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:23.259485 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 65/128] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:23 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:23.261462 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9bfa8-083f-444e-b6f4-e9dd3d389a47 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:23.312969 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:23.360223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe7d7-82b5-451c-b60b-7b6060285b25 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:23.383904 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9bfa8-083f-444e-b6f4-e9dd3d389a47 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:23.396984 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fca9e5-4b3a-4b1e-94d1-58db018c0c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:23.398075 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fca9e5-4b3a-4b1e-94d1-58db018c0c60 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:23.398749 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fca9e5-4b3a-4b1e-94d1-58db018c0c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:23.399033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fca9e5-4b3a-4b1e-94d1-58db018c0c60 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/users/6f02ba7b97474cd7bb2e02b3f9f8106e/roles/fa4a34a109e44660bbce4320a4c9a366` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:23.401304 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fca9e5-4b3a-4b1e-94d1-58db018c0c60 None admin] RBAC: Authorizing `identity:create_grant(project_id=24d37c4bb9ee4e17addb93014168fbdf, user_id=6f02ba7b97474cd7bb2e02b3f9f8106e, role_id=fa4a34a109e44660bbce4320a4c9a366)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:23.403084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fca9e5-4b3a-4b1e-94d1-58db018c0c60 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:23.417703 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 64/129] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:23 2022] PUT /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/users/6f02ba7b97474cd7bb2e02b3f9f8106e/roles/fa4a34a109e44660bbce4320a4c9a366 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:23.418629 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fca9e5-4b3a-4b1e-94d1-58db018c0c60 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:23.430475 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134025b-5681-4931-9df3-963a6735cc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:23.431131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134025b-5681-4931-9df3-963a6735cc2d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:23.431490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134025b-5681-4931-9df3-963a6735cc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:23.431833 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134025b-5681-4931-9df3-963a6735cc2d None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:23.433235 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134025b-5681-4931-9df3-963a6735cc2d None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:23.434821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134025b-5681-4931-9df3-963a6735cc2d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:23.442110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 66/130] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:23 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:23.443116 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134025b-5681-4931-9df3-963a6735cc2d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:23.493986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:23.547067 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fca9e5-4b3a-4b1e-94d1-58db018c0c60 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:23.585248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134025b-5681-4931-9df3-963a6735cc2d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:23.585577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890057db-a8a6-4056-82ed-3319f43577ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:23.586342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890057db-a8a6-4056-82ed-3319f43577ed None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:23.586723 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890057db-a8a6-4056-82ed-3319f43577ed None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:23.587096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890057db-a8a6-4056-82ed-3319f43577ed None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:23.588507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890057db-a8a6-4056-82ed-3319f43577ed None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:23.590116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890057db-a8a6-4056-82ed-3319f43577ed None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:23.591945 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 65/131] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:23 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:23.597229 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890057db-a8a6-4056-82ed-3319f43577ed None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:23.599614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:23.635251 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad196e4-46b4-4ae7-8c7b-1d2a166da0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:23.636059 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad196e4-46b4-4ae7-8c7b-1d2a166da0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:23.636447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad196e4-46b4-4ae7-8c7b-1d2a166da0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:23.636830 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad196e4-46b4-4ae7-8c7b-1d2a166da0b1 None admin] PATH_INFO: `/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:23.638794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad196e4-46b4-4ae7-8c7b-1d2a166da0b1 None admin] RBAC: Authorizing `identity:get_user(user_id=6f02ba7b97474cd7bb2e02b3f9f8106e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:23.640499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad196e4-46b4-4ae7-8c7b-1d2a166da0b1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:23.642476 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 67/132] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:23 2022] GET /identity/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:23.643331 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad196e4-46b4-4ae7-8c7b-1d2a166da0b1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:23.725504 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890057db-a8a6-4056-82ed-3319f43577ed None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:23.755543 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:23.756923 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad196e4-46b4-4ae7-8c7b-1d2a166da0b1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:23.773264 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c16c2-3a03-4e89-9ce7-913b4e0559a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:23.773947 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c16c2-3a03-4e89-9ce7-913b4e0559a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:23.774221 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c16c2-3a03-4e89-9ce7-913b4e0559a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:23.774490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c16c2-3a03-4e89-9ce7-913b4e0559a7 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/users/98027de25a1b4edcab7ee4843ee0a448/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:23.776886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c16c2-3a03-4e89-9ce7-913b4e0559a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=24d37c4bb9ee4e17addb93014168fbdf, user_id=98027de25a1b4edcab7ee4843ee0a448, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:23.778459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c16c2-3a03-4e89-9ce7-913b4e0559a7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:23.796420 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 66/133] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:23 2022] PUT /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/users/98027de25a1b4edcab7ee4843ee0a448/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:23.797304 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c16c2-3a03-4e89-9ce7-913b4e0559a7 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:23.811195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525a681-050b-4dd5-96da-41351de1c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:23.812444 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525a681-050b-4dd5-96da-41351de1c482 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:23.812851 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525a681-050b-4dd5-96da-41351de1c482 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:23.813556 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525a681-050b-4dd5-96da-41351de1c482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:23.814491 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525a681-050b-4dd5-96da-41351de1c482 None admin] RBAC: Adding query filter params (role.id=8fb869cab8f84a7181324bcafe554ba6, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf, user.id=696ed37eab99417ab0a644847889af86) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:23.815245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525a681-050b-4dd5-96da-41351de1c482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:23.817843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525a681-050b-4dd5-96da-41351de1c482 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:23.826553 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 68/134] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:23 2022] GET /identity/v3/role_assignments?user.id=696ed37eab99417ab0a644847889af86&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=8fb869cab8f84a7181324bcafe554ba6 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:23.832885 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525a681-050b-4dd5-96da-41351de1c482 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:23.938663 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:24.013075 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c16c2-3a03-4e89-9ce7-913b4e0559a7 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:24.046029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525a681-050b-4dd5-96da-41351de1c482 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:24.058954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477b055-0260-475b-9a58-5589a961f807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:24.059660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477b055-0260-475b-9a58-5589a961f807 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:24.059936 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477b055-0260-475b-9a58-5589a961f807 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:24.060243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477b055-0260-475b-9a58-5589a961f807 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/users/6f02ba7b97474cd7bb2e02b3f9f8106e/roles/d796a9636e044b848ecdc0f80ee9443d` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:24.066038 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477b055-0260-475b-9a58-5589a961f807 None admin] RBAC: Authorizing `identity:create_grant(project_id=24d37c4bb9ee4e17addb93014168fbdf, user_id=6f02ba7b97474cd7bb2e02b3f9f8106e, role_id=d796a9636e044b848ecdc0f80ee9443d)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:24.067789 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477b055-0260-475b-9a58-5589a961f807 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:24.094778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 67/135] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:23 2022] PUT /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/users/6f02ba7b97474cd7bb2e02b3f9f8106e/roles/d796a9636e044b848ecdc0f80ee9443d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:24.114539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7700c-d897-4d9b-9f78-7179d9f74b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:24.115203 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7700c-d897-4d9b-9f78-7179d9f74b51 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:24.115588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7700c-d897-4d9b-9f78-7179d9f74b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:24.115914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7700c-d897-4d9b-9f78-7179d9f74b51 None admin] PATH_INFO: `/v3/projects/1d03b1a2be954e14ae3a2cc351018c65` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:24.118128 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7700c-d897-4d9b-9f78-7179d9f74b51 None admin] RBAC: Authorizing `identity:get_project(project_id=1d03b1a2be954e14ae3a2cc351018c65)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:24.119724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7700c-d897-4d9b-9f78-7179d9f74b51 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:24.121546 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 69/136] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:23 2022] GET /identity/v3/projects/1d03b1a2be954e14ae3a2cc351018c65 => generated 312 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:24.127836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477b055-0260-475b-9a58-5589a961f807 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:24.191487 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:24.259461 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477b055-0260-475b-9a58-5589a961f807 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:24.304195 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724e383-22e8-4121-b649-6519a5d0758f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:24.305263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e383-22e8-4121-b649-6519a5d0758f None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:24.305739 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e383-22e8-4121-b649-6519a5d0758f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:24.306223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e383-22e8-4121-b649-6519a5d0758f None admin] PATH_INFO: `/v3/projects/1d03b1a2be954e14ae3a2cc351018c65/users/6f02ba7b97474cd7bb2e02b3f9f8106e/roles/fa4a34a109e44660bbce4320a4c9a366` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:24.308523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724e383-22e8-4121-b649-6519a5d0758f None admin] RBAC: Authorizing `identity:create_grant(project_id=1d03b1a2be954e14ae3a2cc351018c65, user_id=6f02ba7b97474cd7bb2e02b3f9f8106e, role_id=fa4a34a109e44660bbce4320a4c9a366)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:24.310322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724e383-22e8-4121-b649-6519a5d0758f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:24.334766 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 68/137] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:24 2022] PUT /identity/v3/projects/1d03b1a2be954e14ae3a2cc351018c65/users/6f02ba7b97474cd7bb2e02b3f9f8106e/roles/fa4a34a109e44660bbce4320a4c9a366 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:42:24.645256 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2845a3-49ca-4453-9eb5-eb26e40d9a82 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:24.645606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2845a3-49ca-4453-9eb5-eb26e40d9a82 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:24.645777 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2845a3-49ca-4453-9eb5-eb26e40d9a82 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:24.647314 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 70/138] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:24.653977 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe31f4-eb0c-44d2-b289-52f80caec3a4 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:24.654343 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe31f4-eb0c-44d2-b289-52f80caec3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:24.654627 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe31f4-eb0c-44d2-b289-52f80caec3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:24.674473 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-1fbe31f4-eb0c-44d2-b289-52f80caec3a4 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:24.675683 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-1fbe31f4-eb0c-44d2-b289-52f80caec3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:24.749832 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 69/139] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:25.029946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2845a3-49ca-4453-9eb5-eb26e40d9a82 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:25.147736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2845a3-49ca-4453-9eb5-eb26e40d9a82 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:25.159594 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:25.184501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fb3b3-1923-4194-9322-23821ddc4cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:25.185199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb3b3-1923-4194-9322-23821ddc4cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:25.185479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb3b3-1923-4194-9322-23821ddc4cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:25.185753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb3b3-1923-4194-9322-23821ddc4cf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:25.186904 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fb3b3-1923-4194-9322-23821ddc4cf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:25.188455 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fb3b3-1923-4194-9322-23821ddc4cf5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:25.190068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 71/140] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:25.195833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe31f4-eb0c-44d2-b289-52f80caec3a4 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:25.232357 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:25.301795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe31f4-eb0c-44d2-b289-52f80caec3a4 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:25.337129 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6f90d-91f1-4c6f-93e5-791a31b7b44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:25.337753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6f90d-91f1-4c6f-93e5-791a31b7b44e None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:25.338032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6f90d-91f1-4c6f-93e5-791a31b7b44e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:25.338304 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6f90d-91f1-4c6f-93e5-791a31b7b44e None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:25.338985 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6f90d-91f1-4c6f-93e5-791a31b7b44e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:25.340457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6f90d-91f1-4c6f-93e5-791a31b7b44e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:25.367849 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 70/141] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:25 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:26.460674 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33686f20-d96c-497b-b0cb-bf223c585ad2 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.461703 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33686f20-d96c-497b-b0cb-bf223c585ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.462184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33686f20-d96c-497b-b0cb-bf223c585ad2 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.463719 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 72/142] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:26.469578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774401be-bbe5-4e07-bde3-03dcdc8253b9 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.470055 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774401be-bbe5-4e07-bde3-03dcdc8253b9 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.470142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774401be-bbe5-4e07-bde3-03dcdc8253b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.489322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-774401be-bbe5-4e07-bde3-03dcdc8253b9 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:26.490622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-774401be-bbe5-4e07-bde3-03dcdc8253b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:26.572036 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 71/143] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:26.818381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b316dc-b6ed-4f9f-a4de-ecaab4bd0b6d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.819115 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b316dc-b6ed-4f9f-a4de-ecaab4bd0b6d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.819581 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b316dc-b6ed-4f9f-a4de-ecaab4bd0b6d None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.821233 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 73/144] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:26.828891 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714e6e0-4eb6-4eb8-897d-00fc4d7215eb None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.829491 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714e6e0-4eb6-4eb8-897d-00fc4d7215eb None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.829963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714e6e0-4eb6-4eb8-897d-00fc4d7215eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.855906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-c714e6e0-4eb6-4eb8-897d-00fc4d7215eb None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:26.857415 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-c714e6e0-4eb6-4eb8-897d-00fc4d7215eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:26.877213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:26.947624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 72/145] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:26.984609 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa82e-73b0-41e7-86dd-dd17a187dba0 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.985244 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa82e-73b0-41e7-86dd-dd17a187dba0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.985724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa82e-73b0-41e7-86dd-dd17a187dba0 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.987264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 74/146] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:26.995263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85448248-62fb-4710-bf42-f80cf190691b None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.995823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85448248-62fb-4710-bf42-f80cf190691b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.996316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85448248-62fb-4710-bf42-f80cf190691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:27.020069 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-85448248-62fb-4710-bf42-f80cf190691b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:27.021753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-85448248-62fb-4710-bf42-f80cf190691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:27.106700 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 73/147] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:27.126222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffa82e-73b0-41e7-86dd-dd17a187dba0 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:27.263875 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffa82e-73b0-41e7-86dd-dd17a187dba0 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:27.306172 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f3ac7-5023-4f6e-9874-40a2c9ede687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:27.306817 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f3ac7-5023-4f6e-9874-40a2c9ede687 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:27.307095 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f3ac7-5023-4f6e-9874-40a2c9ede687 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:27.307361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f3ac7-5023-4f6e-9874-40a2c9ede687 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:27.321657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f3ac7-5023-4f6e-9874-40a2c9ede687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:27.326116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85448248-62fb-4710-bf42-f80cf190691b None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-151f3ac7-5023-4f6e-9874-40a2c9ede687 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:27.326645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:27.327533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:27.328612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 75/148] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:27.334347 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f3ac7-5023-4f6e-9874-40a2c9ede687 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:27.419642 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:27.502853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:27.554119 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85448248-62fb-4710-bf42-f80cf190691b None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:27.559241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f3ac7-5023-4f6e-9874-40a2c9ede687 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:27.628160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26cbaa-cdd5-4106-a604-f8f0fc13e682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:27.629075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26cbaa-cdd5-4106-a604-f8f0fc13e682 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:27.629362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26cbaa-cdd5-4106-a604-f8f0fc13e682 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:27.629744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26cbaa-cdd5-4106-a604-f8f0fc13e682 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:27.630426 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26cbaa-cdd5-4106-a604-f8f0fc13e682 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:27.630753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26cbaa-cdd5-4106-a604-f8f0fc13e682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:27.631300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aab77-3c6f-484b-a98e-7e9e9cf9b34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:27.634898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aab77-3c6f-484b-a98e-7e9e9cf9b34a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:27.634898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aab77-3c6f-484b-a98e-7e9e9cf9b34a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:27.634898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aab77-3c6f-484b-a98e-7e9e9cf9b34a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:27.646287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26cbaa-cdd5-4106-a604-f8f0fc13e682 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:27.662658 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 76/149] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:27.671935 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aab77-3c6f-484b-a98e-7e9e9cf9b34a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:27.672131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26cbaa-cdd5-4106-a604-f8f0fc13e682 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-b35aab77-3c6f-484b-a98e-7e9e9cf9b34a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:27.679302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:27.680583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:27.681380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 74/150] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:27.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aab77-3c6f-484b-a98e-7e9e9cf9b34a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:28.018113 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:28.021709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26cbaa-cdd5-4106-a604-f8f0fc13e682 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:28.026968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aab77-3c6f-484b-a98e-7e9e9cf9b34a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:28.168082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4da7a-16d8-416e-8079-8025d7c9ceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:28.168751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4da7a-16d8-416e-8079-8025d7c9ceae None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:28.169029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4da7a-16d8-416e-8079-8025d7c9ceae None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:28.169345 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4da7a-16d8-416e-8079-8025d7c9ceae None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:28.169982 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4da7a-16d8-416e-8079-8025d7c9ceae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:28.170280 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4da7a-16d8-416e-8079-8025d7c9ceae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:28.176770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd86bf-a9f9-4f6d-9210-4c77b0855944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:28.177723 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd86bf-a9f9-4f6d-9210-4c77b0855944 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:28.178236 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd86bf-a9f9-4f6d-9210-4c77b0855944 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:28.178880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd86bf-a9f9-4f6d-9210-4c77b0855944 None admin] PATH_INFO: `/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:28.183602 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4da7a-16d8-416e-8079-8025d7c9ceae None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:28.184543 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd86bf-a9f9-4f6d-9210-4c77b0855944 None admin] RBAC: Authorizing `identity:get_user(user_id=6f02ba7b97474cd7bb2e02b3f9f8106e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:28.186341 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd86bf-a9f9-4f6d-9210-4c77b0855944 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:28.188219 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 77/151] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:27 2022] GET /identity/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e => generated 275 bytes in 519 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:28.189238 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd86bf-a9f9-4f6d-9210-4c77b0855944 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:28.214518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 75/152] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:28.215254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4da7a-16d8-416e-8079-8025d7c9ceae None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:28.224465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:28.476256 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd86bf-a9f9-4f6d-9210-4c77b0855944 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:28.489872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4da7a-16d8-416e-8079-8025d7c9ceae None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:28.546882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f446-24c7-4187-9ff8-acd43b182094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:28.547971 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f446-24c7-4187-9ff8-acd43b182094 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:28.548457 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f446-24c7-4187-9ff8-acd43b182094 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:28.548969 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f446-24c7-4187-9ff8-acd43b182094 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:28.558678 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9811e-7b80-42de-843d-134e705c972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:28.559298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9811e-7b80-42de-843d-134e705c972d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:28.559741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9811e-7b80-42de-843d-134e705c972d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:28.560178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9811e-7b80-42de-843d-134e705c972d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:28.576713 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8f446-24c7-4187-9ff8-acd43b182094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-43a8f446-24c7-4187-9ff8-acd43b182094 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:28.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:28.583976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:28.585003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:28.588630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 78/153] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:28.589793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f446-24c7-4187-9ff8-acd43b182094 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:28.643830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9811e-7b80-42de-843d-134e705c972d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:28.644647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:28.645479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9811e-7b80-42de-843d-134e705c972d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:28.647531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:28.800126 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f446-24c7-4187-9ff8-acd43b182094 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:28.822064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 76/154] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:28.823351 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069c37c-fb60-4c7b-a32d-606bbb4b092f None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:28.823628 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069c37c-fb60-4c7b-a32d-606bbb4b092f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:28.823895 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069c37c-fb60-4c7b-a32d-606bbb4b092f None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:28.837130 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 77/155] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:28 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:28.837992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069c37c-fb60-4c7b-a32d-606bbb4b092f None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:28.865339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da75436-d92d-49c7-9b80-cde16aaf3c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:28.866146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da75436-d92d-49c7-9b80-cde16aaf3c72 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:28.866426 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da75436-d92d-49c7-9b80-cde16aaf3c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:28.866696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da75436-d92d-49c7-9b80-cde16aaf3c72 None admin] PATH_INFO: `/v3/users/98027de25a1b4edcab7ee4843ee0a448` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:28.869037 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da75436-d92d-49c7-9b80-cde16aaf3c72 None admin] RBAC: Authorizing `identity:get_user(user_id=98027de25a1b4edcab7ee4843ee0a448)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:28.870498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da75436-d92d-49c7-9b80-cde16aaf3c72 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:28.883625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 79/156] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:28 2022] GET /identity/v3/users/98027de25a1b4edcab7ee4843ee0a448 => generated 247 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:28.885003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605225-cf35-41cc-9aa9-4545e5e56b68 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:28.885284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605225-cf35-41cc-9aa9-4545e5e56b68 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:28.885557 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d605225-cf35-41cc-9aa9-4545e5e56b68 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:28.886854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 80/157] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:28.887542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d605225-cf35-41cc-9aa9-4545e5e56b68 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:29.025984 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069c37c-fb60-4c7b-a32d-606bbb4b092f None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:29.028076 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:29.082484 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:29.088217 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d2b70-a5cc-4955-b4e6-b8c8684a1972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:29.088835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d2b70-a5cc-4955-b4e6-b8c8684a1972 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.089103 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d2b70-a5cc-4955-b4e6-b8c8684a1972 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.089957 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d2b70-a5cc-4955-b4e6-b8c8684a1972 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.090820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d2b70-a5cc-4955-b4e6-b8c8684a1972 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:29.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d2b70-a5cc-4955-b4e6-b8c8684a1972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:29.092511 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d2b70-a5cc-4955-b4e6-b8c8684a1972 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:29.097300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d605225-cf35-41cc-9aa9-4545e5e56b68 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:29.113009 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 78/158] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:29.114279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172f9d1-1c6a-4a4f-b683-808dea7b118b None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.114558 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172f9d1-1c6a-4a4f-b683-808dea7b118b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.114826 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172f9d1-1c6a-4a4f-b683-808dea7b118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.147469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-4172f9d1-1c6a-4a4f-b683-808dea7b118b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:29.148667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-4172f9d1-1c6a-4a4f-b683-808dea7b118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:29.158435 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c7576-ac95-4380-b89a-5dbcb4bbf792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:29.159165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c7576-ac95-4380-b89a-5dbcb4bbf792 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.159445 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c7576-ac95-4380-b89a-5dbcb4bbf792 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.159712 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c7576-ac95-4380-b89a-5dbcb4bbf792 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.162589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c7576-ac95-4380-b89a-5dbcb4bbf792 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:29.166272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c7576-ac95-4380-b89a-5dbcb4bbf792 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:29.168895 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 81/159] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:28 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:29.171892 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e79a3-0e41-46b5-968f-cf7423fecb3e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.173455 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e79a3-0e41-46b5-968f-cf7423fecb3e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.173735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e79a3-0e41-46b5-968f-cf7423fecb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.200677 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-dd7e79a3-0e41-46b5-968f-cf7423fecb3e None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:29.201873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dd7e79a3-0e41-46b5-968f-cf7423fecb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:29.257192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 79/160] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:29.259496 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172f9d1-1c6a-4a4f-b683-808dea7b118b None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:29.342338 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 82/161] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:29.343607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e79a3-0e41-46b5-968f-cf7423fecb3e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:29.399293 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:29.413289 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172f9d1-1c6a-4a4f-b683-808dea7b118b None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:29.476610 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb49ce3-9c2b-42a5-a412-20774acf14f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:29.477390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb49ce3-9c2b-42a5-a412-20774acf14f3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.477665 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb49ce3-9c2b-42a5-a412-20774acf14f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.477927 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb49ce3-9c2b-42a5-a412-20774acf14f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.514718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:29.526981 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e79a3-0e41-46b5-968f-cf7423fecb3e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:29.589614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42ed77-9928-4410-9197-512e627cab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:29.590408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42ed77-9928-4410-9197-512e627cab0e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.590588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42ed77-9928-4410-9197-512e627cab0e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.590846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42ed77-9928-4410-9197-512e627cab0e None admin] PATH_INFO: `/v3/users/696ed37eab99417ab0a644847889af86` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.592020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42ed77-9928-4410-9197-512e627cab0e None admin] RBAC: Authorizing `identity:get_user(user_id=696ed37eab99417ab0a644847889af86)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:29.593713 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42ed77-9928-4410-9197-512e627cab0e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:29.595419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 83/162] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:29 2022] GET /identity/v3/users/696ed37eab99417ab0a644847889af86 => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:29.596134 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42ed77-9928-4410-9197-512e627cab0e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:29.617185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb49ce3-9c2b-42a5-a412-20774acf14f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:29.618685 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb49ce3-9c2b-42a5-a412-20774acf14f3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:29.776801 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:29.780602 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42ed77-9928-4410-9197-512e627cab0e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:29.786246 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 80/163] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:29.790196 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508a935-6484-476e-85fc-4e67442a0ebe None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.790196 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508a935-6484-476e-85fc-4e67442a0ebe None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.790196 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508a935-6484-476e-85fc-4e67442a0ebe None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.790196 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 81/164] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:29.790524 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508a935-6484-476e-85fc-4e67442a0ebe None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:29.833216 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392394f-0dc8-408e-8c39-20a720707979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:29.834243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392394f-0dc8-408e-8c39-20a720707979 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.835198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392394f-0dc8-408e-8c39-20a720707979 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.835680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392394f-0dc8-408e-8c39-20a720707979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.837010 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392394f-0dc8-408e-8c39-20a720707979 None admin] RBAC: Adding query filter params (role.id=fa4a34a109e44660bbce4320a4c9a366, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf, user.id=6f02ba7b97474cd7bb2e02b3f9f8106e) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:29.837763 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392394f-0dc8-408e-8c39-20a720707979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:29.840174 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392394f-0dc8-408e-8c39-20a720707979 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:29.848321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 84/165] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:29 2022] GET /identity/v3/role_assignments?user.id=6f02ba7b97474cd7bb2e02b3f9f8106e&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:29.855860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392394f-0dc8-408e-8c39-20a720707979 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:29.911670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:29.953162 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508a935-6484-476e-85fc-4e67442a0ebe None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.017831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb1d1a-ed4e-4019-b9a6-e139c6d0e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.018480 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1d1a-ed4e-4019-b9a6-e139c6d0e4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.018753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1d1a-ed4e-4019-b9a6-e139c6d0e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.019028 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1d1a-ed4e-4019-b9a6-e139c6d0e4e6 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.020215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb1d1a-ed4e-4019-b9a6-e139c6d0e4e6 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.021759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb1d1a-ed4e-4019-b9a6-e139c6d0e4e6 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.023649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 82/166] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:29 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:30.029121 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb1d1a-ed4e-4019-b9a6-e139c6d0e4e6 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.040303 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392394f-0dc8-408e-8c39-20a720707979 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.078818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccac115-f484-48e5-8564-d4b32bfe55d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.079861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccac115-f484-48e5-8564-d4b32bfe55d0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.080358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccac115-f484-48e5-8564-d4b32bfe55d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.080770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccac115-f484-48e5-8564-d4b32bfe55d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.094559 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccac115-f484-48e5-8564-d4b32bfe55d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-eccac115-f484-48e5-8564-d4b32bfe55d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:30.099447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:30.100492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:30.101539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 85/167] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:30.102223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccac115-f484-48e5-8564-d4b32bfe55d0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.105151 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.161601 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb1d1a-ed4e-4019-b9a6-e139c6d0e4e6 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.203221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.205857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e040c3-9ca8-4e0c-a444-bd7d6d037fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.207067 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e040c3-9ca8-4e0c-a444-bd7d6d037fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.207067 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e040c3-9ca8-4e0c-a444-bd7d6d037fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.207067 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e040c3-9ca8-4e0c-a444-bd7d6d037fb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.222490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e040c3-9ca8-4e0c-a444-bd7d6d037fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:30.226147 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccac115-f484-48e5-8564-d4b32bfe55d0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-c5e040c3-9ca8-4e0c-a444-bd7d6d037fb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:30.227498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:30.228483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:30.229285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 83/168] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:30.231479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c49a96-7ef2-4b9f-b5de-da8ea61e4f85 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.231757 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c49a96-7ef2-4b9f-b5de-da8ea61e4f85 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c49a96-7ef2-4b9f-b5de-da8ea61e4f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.252166 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-e1c49a96-7ef2-4b9f-b5de-da8ea61e4f85 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:30.253344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e1c49a96-7ef2-4b9f-b5de-da8ea61e4f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:30.265667 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3c916-1349-416f-b314-8d938823bb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.266589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3c916-1349-416f-b314-8d938823bb8b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.267184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3c916-1349-416f-b314-8d938823bb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.267664 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3c916-1349-416f-b314-8d938823bb8b None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.269120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3c916-1349-416f-b314-8d938823bb8b None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.271073 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3c916-1349-416f-b314-8d938823bb8b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.273187 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 86/169] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:30.274485 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c53b41-b34e-48a4-9046-6aa62b0488de None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.275011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c53b41-b34e-48a4-9046-6aa62b0488de None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.275519 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c53b41-b34e-48a4-9046-6aa62b0488de None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.276989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 87/170] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:30.277957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c53b41-b34e-48a4-9046-6aa62b0488de None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.328095 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 84/171] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:30.328095 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c49a96-7ef2-4b9f-b5de-da8ea61e4f85 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.378611 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.387004 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c53b41-b34e-48a4-9046-6aa62b0488de None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.421550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5444-3e2a-44c7-b6a1-f18ab70ee109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.422203 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5444-3e2a-44c7-b6a1-f18ab70ee109 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.422477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5444-3e2a-44c7-b6a1-f18ab70ee109 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.422744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5444-3e2a-44c7-b6a1-f18ab70ee109 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/users/696ed37eab99417ab0a644847889af86/roles/8fb869cab8f84a7181324bcafe554ba6` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.424825 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa5444-3e2a-44c7-b6a1-f18ab70ee109 None admin] RBAC: Authorizing `identity:create_grant(project_id=24d37c4bb9ee4e17addb93014168fbdf, user_id=696ed37eab99417ab0a644847889af86, role_id=8fb869cab8f84a7181324bcafe554ba6)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.426849 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa5444-3e2a-44c7-b6a1-f18ab70ee109 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.428657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c49a96-7ef2-4b9f-b5de-da8ea61e4f85 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.442195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 88/172] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:30 2022] PUT /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/users/696ed37eab99417ab0a644847889af86/roles/8fb869cab8f84a7181324bcafe554ba6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:30.453025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5444-3e2a-44c7-b6a1-f18ab70ee109 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.468559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631eb15-aeb5-4174-a497-7abc8ffe89fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.469038 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631eb15-aeb5-4174-a497-7abc8ffe89fa None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.469403 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631eb15-aeb5-4174-a497-7abc8ffe89fa None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.469841 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631eb15-aeb5-4174-a497-7abc8ffe89fa None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.470674 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631eb15-aeb5-4174-a497-7abc8ffe89fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:30.471098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631eb15-aeb5-4174-a497-7abc8ffe89fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.472833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631eb15-aeb5-4174-a497-7abc8ffe89fa None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.480601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.488098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 85/173] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:30.488098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631eb15-aeb5-4174-a497-7abc8ffe89fa None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.595827 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5444-3e2a-44c7-b6a1-f18ab70ee109 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.621457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631eb15-aeb5-4174-a497-7abc8ffe89fa None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.635417 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8b6bd-afa3-48e2-809b-2bf78ce84e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.635911 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8b6bd-afa3-48e2-809b-2bf78ce84e62 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.636213 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8b6bd-afa3-48e2-809b-2bf78ce84e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.636485 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8b6bd-afa3-48e2-809b-2bf78ce84e62 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.637143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8b6bd-afa3-48e2-809b-2bf78ce84e62 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:30.637440 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8b6bd-afa3-48e2-809b-2bf78ce84e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.638841 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8b6bd-afa3-48e2-809b-2bf78ce84e62 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.639651 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.648000 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 89/174] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:30.649309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1279c-4063-4c40-8db1-acf65a64a320 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.649589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1279c-4063-4c40-8db1-acf65a64a320 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.649859 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1279c-4063-4c40-8db1-acf65a64a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.667085 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7e224-fc42-4a63-93ea-4a82c04cbf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.668103 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7e224-fc42-4a63-93ea-4a82c04cbf71 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.668572 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7e224-fc42-4a63-93ea-4a82c04cbf71 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.668756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-14b1279c-4063-4c40-8db1-acf65a64a320 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:30.669206 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7e224-fc42-4a63-93ea-4a82c04cbf71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.669926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-14b1279c-4063-4c40-8db1-acf65a64a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:30.670336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7e224-fc42-4a63-93ea-4a82c04cbf71 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf, user.id=98027de25a1b4edcab7ee4843ee0a448) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:30.670829 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7e224-fc42-4a63-93ea-4a82c04cbf71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.672479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7e224-fc42-4a63-93ea-4a82c04cbf71 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.678812 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 86/175] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/role_assignments?user.id=98027de25a1b4edcab7ee4843ee0a448&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:30.680280 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d3e63-4e8a-494f-bf11-38c0fb81e973 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.680753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d3e63-4e8a-494f-bf11-38c0fb81e973 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.681221 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d3e63-4e8a-494f-bf11-38c0fb81e973 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.682616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 87/176] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:30.683481 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d3e63-4e8a-494f-bf11-38c0fb81e973 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.771449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 90/177] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:30.772808 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1279c-4063-4c40-8db1-acf65a64a320 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.781624 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.812116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d3e63-4e8a-494f-bf11-38c0fb81e973 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.849344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987ec2a-2149-47c0-a15b-077fb06e2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.850669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ec2a-2149-47c0-a15b-077fb06e2421 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.851143 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ec2a-2149-47c0-a15b-077fb06e2421 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.851548 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ec2a-2149-47c0-a15b-077fb06e2421 None admin] PATH_INFO: `/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.852905 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987ec2a-2149-47c0-a15b-077fb06e2421 None admin] RBAC: Authorizing `identity:get_user(user_id=6f02ba7b97474cd7bb2e02b3f9f8106e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.854527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987ec2a-2149-47c0-a15b-077fb06e2421 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.856471 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 88/178] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:30.857466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987ec2a-2149-47c0-a15b-077fb06e2421 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.884023 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1279c-4063-4c40-8db1-acf65a64a320 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.909841 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.922429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eba43-d4a3-4ff4-a989-7b119229cb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.923209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eba43-d4a3-4ff4-a989-7b119229cb2e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.923579 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eba43-d4a3-4ff4-a989-7b119229cb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.923943 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eba43-d4a3-4ff4-a989-7b119229cb2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.935139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eba43-d4a3-4ff4-a989-7b119229cb2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a62eba43-d4a3-4ff4-a989-7b119229cb2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:30.940241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:30.941482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:30.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:30.943620 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 91/179] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:30.947009 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907c612-a01d-4466-9188-2c6247cba4fb None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.947009 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907c612-a01d-4466-9188-2c6247cba4fb None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.947009 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907c612-a01d-4466-9188-2c6247cba4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.965289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d907c612-a01d-4466-9188-2c6247cba4fb None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:30.967446 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d907c612-a01d-4466-9188-2c6247cba4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:30.980127 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987ec2a-2149-47c0-a15b-077fb06e2421 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.021419 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297ca7-0636-4cca-9079-28f23c586728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.022570 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297ca7-0636-4cca-9079-28f23c586728 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.023066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297ca7-0636-4cca-9079-28f23c586728 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.023531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297ca7-0636-4cca-9079-28f23c586728 None admin] PATH_INFO: `/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.025032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297ca7-0636-4cca-9079-28f23c586728 None admin] RBAC: Authorizing `identity:get_user(user_id=6f02ba7b97474cd7bb2e02b3f9f8106e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.026703 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297ca7-0636-4cca-9079-28f23c586728 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.029536 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 89/180] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/users/6f02ba7b97474cd7bb2e02b3f9f8106e => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:31.030565 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297ca7-0636-4cca-9079-28f23c586728 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.036585 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.048262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 92/181] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:31.049296 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907c612-a01d-4466-9188-2c6247cba4fb None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.154052 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297ca7-0636-4cca-9079-28f23c586728 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.172702 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.183360 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907c612-a01d-4466-9188-2c6247cba4fb None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.202654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002f29a-03d4-48ed-99e5-680c4e09a3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.203636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002f29a-03d4-48ed-99e5-680c4e09a3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.203908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002f29a-03d4-48ed-99e5-680c4e09a3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.204213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002f29a-03d4-48ed-99e5-680c4e09a3a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.219781 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679c049-3c4f-433f-ba9b-ab282f9d9f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.220410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679c049-3c4f-433f-ba9b-ab282f9d9f5c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.220679 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679c049-3c4f-433f-ba9b-ab282f9d9f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.220940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679c049-3c4f-433f-ba9b-ab282f9d9f5c None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.221594 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679c049-3c4f-433f-ba9b-ab282f9d9f5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:31.221884 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679c049-3c4f-433f-ba9b-ab282f9d9f5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.223272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679c049-3c4f-433f-ba9b-ab282f9d9f5c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.232129 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 93/182] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:31.233023 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679c049-3c4f-433f-ba9b-ab282f9d9f5c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.289847 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002f29a-03d4-48ed-99e5-680c4e09a3a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.291453 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002f29a-03d4-48ed-99e5-680c4e09a3a1 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.307253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.354553 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679c049-3c4f-433f-ba9b-ab282f9d9f5c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.389954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13dab0-eaac-4790-96d6-595eb0d92b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.390559 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13dab0-eaac-4790-96d6-595eb0d92b4f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.391014 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13dab0-eaac-4790-96d6-595eb0d92b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.391185 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13dab0-eaac-4790-96d6-595eb0d92b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.416323 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 90/183] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:31.417457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002f29a-03d4-48ed-99e5-680c4e09a3a1 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.435071 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.461755 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13dab0-eaac-4790-96d6-595eb0d92b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.463729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13dab0-eaac-4790-96d6-595eb0d92b4f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.521855 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.532938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002f29a-03d4-48ed-99e5-680c4e09a3a1 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.567075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 94/184] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:31.567911 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13dab0-eaac-4790-96d6-595eb0d92b4f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.571593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663beba-5c5a-49b7-b60a-ad7a4987fac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.571593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663beba-5c5a-49b7-b60a-ad7a4987fac7 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.571916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663beba-5c5a-49b7-b60a-ad7a4987fac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.572227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663beba-5c5a-49b7-b60a-ad7a4987fac7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.582710 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663beba-5c5a-49b7-b60a-ad7a4987fac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-1663beba-5c5a-49b7-b60a-ad7a4987fac7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:31.588342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:31.589249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:31.590079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 91/185] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:31.590787 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663beba-5c5a-49b7-b60a-ad7a4987fac7 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.665583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.676889 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13dab0-eaac-4790-96d6-595eb0d92b4f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.691819 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663beba-5c5a-49b7-b60a-ad7a4987fac7 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.711067 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5469237-31e1-486a-8926-b52c9042527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.711692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469237-31e1-486a-8926-b52c9042527e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.711961 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469237-31e1-486a-8926-b52c9042527e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.712255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469237-31e1-486a-8926-b52c9042527e None admin] PATH_INFO: `/v3/users/43fd34ae845b4971aa466c4ccd21a58c` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.725713 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5469237-31e1-486a-8926-b52c9042527e None admin] RBAC: Authorizing `identity:get_user(user_id=43fd34ae845b4971aa466c4ccd21a58c)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.727160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2573f-a3d5-4c4b-8cfb-061cba054a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.727279 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5469237-31e1-486a-8926-b52c9042527e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.727797 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2573f-a3d5-4c4b-8cfb-061cba054a65 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.728091 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2573f-a3d5-4c4b-8cfb-061cba054a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.728360 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2573f-a3d5-4c4b-8cfb-061cba054a65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.733298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 95/186] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/users/43fd34ae845b4971aa466c4ccd21a58c => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:31.733422 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2573f-a3d5-4c4b-8cfb-061cba054a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.733515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5469237-31e1-486a-8926-b52c9042527e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.733596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2573f-a3d5-4c4b-8cfb-061cba054a65 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.733596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 92/187] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:31.737834 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2573f-a3d5-4c4b-8cfb-061cba054a65 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.749657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.839323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5469237-31e1-486a-8926-b52c9042527e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.849226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2573f-a3d5-4c4b-8cfb-061cba054a65 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.875259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859cce3-e6fa-45a2-a68a-f8d2599ca599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.875882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859cce3-e6fa-45a2-a68a-f8d2599ca599 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.876197 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859cce3-e6fa-45a2-a68a-f8d2599ca599 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.876463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859cce3-e6fa-45a2-a68a-f8d2599ca599 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.877568 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859cce3-e6fa-45a2-a68a-f8d2599ca599 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.879018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859cce3-e6fa-45a2-a68a-f8d2599ca599 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.885520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114b35b-4605-4774-85a8-22c1e49d215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.885887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 96/188] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:31.886162 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114b35b-4605-4774-85a8-22c1e49d215e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.886432 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114b35b-4605-4774-85a8-22c1e49d215e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.886697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114b35b-4605-4774-85a8-22c1e49d215e None admin] PATH_INFO: `/v3/projects/1d03b1a2be954e14ae3a2cc351018c65` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.886799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859cce3-e6fa-45a2-a68a-f8d2599ca599 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.887980 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114b35b-4605-4774-85a8-22c1e49d215e None admin] RBAC: Authorizing `identity:get_project(project_id=1d03b1a2be954e14ae3a2cc351018c65)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.889463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114b35b-4605-4774-85a8-22c1e49d215e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.891197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 93/189] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/projects/1d03b1a2be954e14ae3a2cc351018c65 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:31.891820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114b35b-4605-4774-85a8-22c1e49d215e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.905023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.978439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.997404 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114b35b-4605-4774-85a8-22c1e49d215e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.001176 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859cce3-e6fa-45a2-a68a-f8d2599ca599 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.035163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e49c5-f53f-413a-a4d4-f36bc3ac5998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.035772 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e49c5-f53f-413a-a4d4-f36bc3ac5998 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.036066 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e49c5-f53f-413a-a4d4-f36bc3ac5998 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.036344 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e49c5-f53f-413a-a4d4-f36bc3ac5998 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.036995 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e49c5-f53f-413a-a4d4-f36bc3ac5998 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:32.037393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e49c5-f53f-413a-a4d4-f36bc3ac5998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.038037 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea1a36-4fac-437a-af68-29f014595c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.038644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea1a36-4fac-437a-af68-29f014595c91 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.038885 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e49c5-f53f-413a-a4d4-f36bc3ac5998 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.039004 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea1a36-4fac-437a-af68-29f014595c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.039185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea1a36-4fac-437a-af68-29f014595c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.047210 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 97/190] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:32.047812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e49c5-f53f-413a-a4d4-f36bc3ac5998 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.117146 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea1a36-4fac-437a-af68-29f014595c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.118815 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea1a36-4fac-437a-af68-29f014595c91 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.130967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.154747 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e49c5-f53f-413a-a4d4-f36bc3ac5998 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.189820 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0f18f-5329-4703-a2a2-3a47aada219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.190551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f18f-5329-4703-a2a2-3a47aada219a None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.190823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f18f-5329-4703-a2a2-3a47aada219a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.191142 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0f18f-5329-4703-a2a2-3a47aada219a None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.191848 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0f18f-5329-4703-a2a2-3a47aada219a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.193469 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0f18f-5329-4703-a2a2-3a47aada219a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.223187 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 94/191] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:32.224033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea1a36-4fac-437a-af68-29f014595c91 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.236427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 98/192] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:32 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:32.236427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0f18f-5329-4703-a2a2-3a47aada219a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.238390 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.355263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0f18f-5329-4703-a2a2-3a47aada219a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.363643 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea1a36-4fac-437a-af68-29f014595c91 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.378141 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.401385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d6240-ff34-4208-8120-43adc7012c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.402266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d6240-ff34-4208-8120-43adc7012c5a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.402800 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d6240-ff34-4208-8120-43adc7012c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.403209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d6240-ff34-4208-8120-43adc7012c5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.404213 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d6240-ff34-4208-8120-43adc7012c5a None admin] RBAC: Adding query filter params (role.id=fa4a34a109e44660bbce4320a4c9a366, scope.project.id=1d03b1a2be954e14ae3a2cc351018c65, user.id=6f02ba7b97474cd7bb2e02b3f9f8106e) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:32.404665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d6240-ff34-4208-8120-43adc7012c5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.406300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d6240-ff34-4208-8120-43adc7012c5a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.408676 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce625976-93b7-486c-8f65-fe6e7fe557c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.409305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce625976-93b7-486c-8f65-fe6e7fe557c0 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.409579 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce625976-93b7-486c-8f65-fe6e7fe557c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.409862 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce625976-93b7-486c-8f65-fe6e7fe557c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.411112 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce625976-93b7-486c-8f65-fe6e7fe557c0 None admin] RBAC: Adding query filter params (role.id=d796a9636e044b848ecdc0f80ee9443d, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf, user.id=6f02ba7b97474cd7bb2e02b3f9f8106e) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:32.411421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce625976-93b7-486c-8f65-fe6e7fe557c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.413418 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce625976-93b7-486c-8f65-fe6e7fe557c0 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.414299 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 99/193] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/role_assignments?user.id=6f02ba7b97474cd7bb2e02b3f9f8106e&scope.project.id=1d03b1a2be954e14ae3a2cc351018c65&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:32.415339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d6240-ff34-4208-8120-43adc7012c5a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.428859 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 95/194] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/role_assignments?user.id=6f02ba7b97474cd7bb2e02b3f9f8106e&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=d796a9636e044b848ecdc0f80ee9443d => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:32.429942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce625976-93b7-486c-8f65-fe6e7fe557c0 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.513765 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.572566 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d6240-ff34-4208-8120-43adc7012c5a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.582813 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce625976-93b7-486c-8f65-fe6e7fe557c0 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.627624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26814f1-b3fc-424e-8f44-1045a55cef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.628683 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26814f1-b3fc-424e-8f44-1045a55cef02 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.628960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26814f1-b3fc-424e-8f44-1045a55cef02 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.629233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26814f1-b3fc-424e-8f44-1045a55cef02 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.631266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26814f1-b3fc-424e-8f44-1045a55cef02 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.633138 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336855d-a45f-4b45-ad21-e206bbfc1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.633805 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336855d-a45f-4b45-ad21-e206bbfc1d7c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.634077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336855d-a45f-4b45-ad21-e206bbfc1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.634344 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336855d-a45f-4b45-ad21-e206bbfc1d7c None admin] PATH_INFO: `/v3/users/43fd34ae845b4971aa466c4ccd21a58c` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.635767 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26814f1-b3fc-424e-8f44-1045a55cef02 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.638493 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336855d-a45f-4b45-ad21-e206bbfc1d7c None admin] RBAC: Authorizing `identity:get_user(user_id=43fd34ae845b4971aa466c4ccd21a58c)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.640136 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336855d-a45f-4b45-ad21-e206bbfc1d7c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.641499 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 96/195] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:32.642517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 100/196] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/users/43fd34ae845b4971aa466c4ccd21a58c => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:32.649090 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26814f1-b3fc-424e-8f44-1045a55cef02 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.650948 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336855d-a45f-4b45-ad21-e206bbfc1d7c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.728406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.804791 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26814f1-b3fc-424e-8f44-1045a55cef02 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.813358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336855d-a45f-4b45-ad21-e206bbfc1d7c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.849895 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18fd13-4264-46b9-9c07-30edd99acae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.850688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18fd13-4264-46b9-9c07-30edd99acae8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.850963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18fd13-4264-46b9-9c07-30edd99acae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.851233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18fd13-4264-46b9-9c07-30edd99acae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.852099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18fd13-4264-46b9-9c07-30edd99acae8 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=f8531c2d09da496ab76402401d9fc34b, user.id=43fd34ae845b4971aa466c4ccd21a58c) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:32.852407 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18fd13-4264-46b9-9c07-30edd99acae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18fd13-4264-46b9-9c07-30edd99acae8 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.857180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3a75-722a-47c6-9f01-92d90174b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.857995 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3a75-722a-47c6-9f01-92d90174b16c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.858436 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3a75-722a-47c6-9f01-92d90174b16c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.859345 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3a75-722a-47c6-9f01-92d90174b16c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.863854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.864013 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 97/197] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/role_assignments?user.id=43fd34ae845b4971aa466c4ccd21a58c&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:32.951057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb3a75-722a-47c6-9f01-92d90174b16c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.952667 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb3a75-722a-47c6-9f01-92d90174b16c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.960366 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303281-0753-4716-864b-9ad6976ab1dd None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.960651 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303281-0753-4716-864b-9ad6976ab1dd None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.960922 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303281-0753-4716-864b-9ad6976ab1dd None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.962351 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 98/198] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:32.972561 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcb894-94a2-4f3d-9de4-eaab5ce9ca46 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.972899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcb894-94a2-4f3d-9de4-eaab5ce9ca46 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.973177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcb894-94a2-4f3d-9de4-eaab5ce9ca46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.995992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-80bcb894-94a2-4f3d-9de4-eaab5ce9ca46 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:32.999468 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-80bcb894-94a2-4f3d-9de4-eaab5ce9ca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:33.082478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 101/199] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:33.089142 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3a75-722a-47c6-9f01-92d90174b16c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.096588 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 99/200] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:33.125909 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.195757 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3a75-722a-47c6-9f01-92d90174b16c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.230796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab1c6b-3093-473a-8c7a-d7e5b7f2e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.231490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab1c6b-3093-473a-8c7a-d7e5b7f2e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.231770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab1c6b-3093-473a-8c7a-d7e5b7f2e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.232038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab1c6b-3093-473a-8c7a-d7e5b7f2e2e8 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.233185 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab1c6b-3093-473a-8c7a-d7e5b7f2e2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.234640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab1c6b-3093-473a-8c7a-d7e5b7f2e2e8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.236701 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 102/201] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:33.243185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcb894-94a2-4f3d-9de4-eaab5ce9ca46 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.280651 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.349126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcb894-94a2-4f3d-9de4-eaab5ce9ca46 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.381655 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab1c6b-3093-473a-8c7a-d7e5b7f2e2e8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.392503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a6a3b-fdab-475b-8e81-7fc122277026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.393413 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a6a3b-fdab-475b-8e81-7fc122277026 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.393970 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a6a3b-fdab-475b-8e81-7fc122277026 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.394443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a6a3b-fdab-475b-8e81-7fc122277026 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.395467 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a6a3b-fdab-475b-8e81-7fc122277026 None admin] RBAC: Adding query filter params (role.id=d796a9636e044b848ecdc0f80ee9443d, scope.project.id=f8531c2d09da496ab76402401d9fc34b, user.id=43fd34ae845b4971aa466c4ccd21a58c) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:33.395975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a6a3b-fdab-475b-8e81-7fc122277026 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.397738 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a6a3b-fdab-475b-8e81-7fc122277026 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.412617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 100/202] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/role_assignments?user.id=43fd34ae845b4971aa466c4ccd21a58c&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=d796a9636e044b848ecdc0f80ee9443d => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:33.535822 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab1c6b-3093-473a-8c7a-d7e5b7f2e2e8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.537449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.589813 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da875244-5b2c-4c7c-9938-15e232f75830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.590463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da875244-5b2c-4c7c-9938-15e232f75830 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.590739 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da875244-5b2c-4c7c-9938-15e232f75830 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.591008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da875244-5b2c-4c7c-9938-15e232f75830 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.603900 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da875244-5b2c-4c7c-9938-15e232f75830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-da875244-5b2c-4c7c-9938-15e232f75830 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:33.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:33.610429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:33.611245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 103/203] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:33.618643 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a6a3b-fdab-475b-8e81-7fc122277026 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.760350 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.773401 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a6a3b-fdab-475b-8e81-7fc122277026 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.817838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db292f76-cd0b-4aaa-b820-dbb08e011391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.818579 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db292f76-cd0b-4aaa-b820-dbb08e011391 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.818934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db292f76-cd0b-4aaa-b820-dbb08e011391 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.819207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db292f76-cd0b-4aaa-b820-dbb08e011391 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.819861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db292f76-cd0b-4aaa-b820-dbb08e011391 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:33.820186 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db292f76-cd0b-4aaa-b820-dbb08e011391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.825599 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db292f76-cd0b-4aaa-b820-dbb08e011391 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.845032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 101/204] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:33.851364 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da875244-5b2c-4c7c-9938-15e232f75830 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.992368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da875244-5b2c-4c7c-9938-15e232f75830 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.041661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa6382-c6e8-4a0c-8ccd-80568e7d3d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.042336 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa6382-c6e8-4a0c-8ccd-80568e7d3d82 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.042615 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa6382-c6e8-4a0c-8ccd-80568e7d3d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.042886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa6382-c6e8-4a0c-8ccd-80568e7d3d82 None admin] PATH_INFO: `/v3/users/696ed37eab99417ab0a644847889af86` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.044229 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa6382-c6e8-4a0c-8ccd-80568e7d3d82 None admin] RBAC: Authorizing `identity:get_user(user_id=696ed37eab99417ab0a644847889af86)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.045750 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa6382-c6e8-4a0c-8ccd-80568e7d3d82 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.047633 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 104/205] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/users/696ed37eab99417ab0a644847889af86 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:34.053432 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db292f76-cd0b-4aaa-b820-dbb08e011391 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.178639 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db292f76-cd0b-4aaa-b820-dbb08e011391 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.224477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dab75-d416-4b30-bbff-6fead91432a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.225144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dab75-d416-4b30-bbff-6fead91432a5 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.225412 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dab75-d416-4b30-bbff-6fead91432a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.225679 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dab75-d416-4b30-bbff-6fead91432a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.257561 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:34.309040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dab75-d416-4b30-bbff-6fead91432a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.310554 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dab75-d416-4b30-bbff-6fead91432a5 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.435578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 102/206] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:34.441180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa6382-c6e8-4a0c-8ccd-80568e7d3d82 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.480189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:34.570136 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa6382-c6e8-4a0c-8ccd-80568e7d3d82 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.614487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ae17d-fe4f-4ca8-b1e9-fc74b3503d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.615122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ae17d-fe4f-4ca8-b1e9-fc74b3503d4d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.615449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ae17d-fe4f-4ca8-b1e9-fc74b3503d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.615766 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ae17d-fe4f-4ca8-b1e9-fc74b3503d4d None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.616934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ae17d-fe4f-4ca8-b1e9-fc74b3503d4d None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.618399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ae17d-fe4f-4ca8-b1e9-fc74b3503d4d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.620353 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 105/207] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:34 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:34.629198 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dab75-d416-4b30-bbff-6fead91432a5 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.712536 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:34.760293 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dab75-d416-4b30-bbff-6fead91432a5 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.796073 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ceaba9-b758-40e9-b8c1-754917c02e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.796792 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceaba9-b758-40e9-b8c1-754917c02e0d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.796972 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceaba9-b758-40e9-b8c1-754917c02e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.797249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceaba9-b758-40e9-b8c1-754917c02e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.797987 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ceaba9-b758-40e9-b8c1-754917c02e0d None admin] RBAC: Adding query filter params (role.id=8fb869cab8f84a7181324bcafe554ba6, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf, user.id=696ed37eab99417ab0a644847889af86) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:34.798290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ceaba9-b758-40e9-b8c1-754917c02e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.799765 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ceaba9-b758-40e9-b8c1-754917c02e0d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.806905 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 103/208] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:34 2022] GET /identity/v3/role_assignments?user.id=696ed37eab99417ab0a644847889af86&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=8fb869cab8f84a7181324bcafe554ba6 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:35.445548 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae28e8-ac55-4c93-ad63-a2e485fe3804 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.446085 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae28e8-ac55-4c93-ad63-a2e485fe3804 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.446368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae28e8-ac55-4c93-ad63-a2e485fe3804 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.448103 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 106/209] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:35.453813 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec7fa-4c40-4c78-8216-83a46c21707d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.454142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec7fa-4c40-4c78-8216-83a46c21707d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.454363 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec7fa-4c40-4c78-8216-83a46c21707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.474491 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-a59ec7fa-4c40-4c78-8216-83a46c21707d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:35.476153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-a59ec7fa-4c40-4c78-8216-83a46c21707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:35.536443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d9296-ff14-4b6a-9ed1-7d53b4ada764 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.536737 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d9296-ff14-4b6a-9ed1-7d53b4ada764 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.536987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d9296-ff14-4b6a-9ed1-7d53b4ada764 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.538647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 107/210] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:35.545384 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec967-f500-4233-9dcb-56102de76185 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.545936 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec967-f500-4233-9dcb-56102de76185 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.546499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec967-f500-4233-9dcb-56102de76185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.553652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 104/211] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:35.558883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76c8c0-779c-4686-97cc-aa86f65f58bf None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.559162 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76c8c0-779c-4686-97cc-aa86f65f58bf None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.559429 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76c8c0-779c-4686-97cc-aa86f65f58bf None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.560772 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 105/212] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:35.565943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39888c5e-d0a0-4bcc-8284-448095f52c72 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.566224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39888c5e-d0a0-4bcc-8284-448095f52c72 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.566493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39888c5e-d0a0-4bcc-8284-448095f52c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.567816 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-589ec967-f500-4233-9dcb-56102de76185 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:35.569656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-589ec967-f500-4233-9dcb-56102de76185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:35.587191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-39888c5e-d0a0-4bcc-8284-448095f52c72 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:35.588407 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-39888c5e-d0a0-4bcc-8284-448095f52c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:35.646586 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:35.652921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 108/213] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:35.664393 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 106/214] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:35.822871 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ec967-f500-4233-9dcb-56102de76185 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:35.851975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:35.929747 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ec967-f500-4233-9dcb-56102de76185 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:35.942824 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39888c5e-d0a0-4bcc-8284-448095f52c72 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:35.969214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ed663-273e-4ec4-92fb-79afbf61da3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:35.969847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ed663-273e-4ec4-92fb-79afbf61da3c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.970123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ed663-273e-4ec4-92fb-79afbf61da3c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.970393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ed663-273e-4ec4-92fb-79afbf61da3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.981101 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ed663-273e-4ec4-92fb-79afbf61da3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-409ed663-273e-4ec4-92fb-79afbf61da3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:35.985958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:35.986873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:35.987692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 109/215] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:35.988993 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ed663-273e-4ec4-92fb-79afbf61da3c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.053583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39888c5e-d0a0-4bcc-8284-448095f52c72 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.082005 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.093682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e7263-821f-4d0f-87f7-ae3db533288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.094390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e7263-821f-4d0f-87f7-ae3db533288f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.094656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e7263-821f-4d0f-87f7-ae3db533288f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.094918 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e7263-821f-4d0f-87f7-ae3db533288f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.096950 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ed663-273e-4ec4-92fb-79afbf61da3c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.105396 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e7263-821f-4d0f-87f7-ae3db533288f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-259e7263-821f-4d0f-87f7-ae3db533288f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:36.110975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:36.111943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:36.112912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 107/216] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:36.117282 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e7263-821f-4d0f-87f7-ae3db533288f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.139489 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82389f3-d127-463c-b203-ba0a0ba29a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.140152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82389f3-d127-463c-b203-ba0a0ba29a71 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.140428 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82389f3-d127-463c-b203-ba0a0ba29a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.140693 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82389f3-d127-463c-b203-ba0a0ba29a71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.141817 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82389f3-d127-463c-b203-ba0a0ba29a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.143355 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82389f3-d127-463c-b203-ba0a0ba29a71 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.144949 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 110/217] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:36.149165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82389f3-d127-463c-b203-ba0a0ba29a71 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.167575 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.220736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e7263-821f-4d0f-87f7-ae3db533288f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.245176 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82389f3-d127-463c-b203-ba0a0ba29a71 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.252614 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135501d7-f977-4bad-ba99-c533f00a4f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.253224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135501d7-f977-4bad-ba99-c533f00a4f55 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.253498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135501d7-f977-4bad-ba99-c533f00a4f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.253768 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135501d7-f977-4bad-ba99-c533f00a4f55 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.254423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135501d7-f977-4bad-ba99-c533f00a4f55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:36.254715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135501d7-f977-4bad-ba99-c533f00a4f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.256262 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135501d7-f977-4bad-ba99-c533f00a4f55 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.264962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 108/218] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:36.271670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f846c9b-0291-4dee-adff-1c2c45eac9cc None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.271670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f846c9b-0291-4dee-adff-1c2c45eac9cc None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.271670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f846c9b-0291-4dee-adff-1c2c45eac9cc None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.271670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 109/219] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:36.271670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f846c9b-0291-4dee-adff-1c2c45eac9cc None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.283529 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbeab0-0efc-4e18-942f-b156fd1d0bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.284163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbeab0-0efc-4e18-942f-b156fd1d0bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.284436 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbeab0-0efc-4e18-942f-b156fd1d0bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.284704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbeab0-0efc-4e18-942f-b156fd1d0bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.285358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbeab0-0efc-4e18-942f-b156fd1d0bf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:36.285650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbeab0-0efc-4e18-942f-b156fd1d0bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.287041 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbeab0-0efc-4e18-942f-b156fd1d0bf5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.295353 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 111/220] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:36.296911 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbeab0-0efc-4e18-942f-b156fd1d0bf5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.315857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.375785 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f846c9b-0291-4dee-adff-1c2c45eac9cc None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.385811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.396582 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbeab0-0efc-4e18-942f-b156fd1d0bf5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.410886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171d789-1950-4deb-9920-ac6a7df9b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.411488 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d789-1950-4deb-9920-ac6a7df9b095 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.411762 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d789-1950-4deb-9920-ac6a7df9b095 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.412267 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d789-1950-4deb-9920-ac6a7df9b095 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.412774 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171d789-1950-4deb-9920-ac6a7df9b095 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.414325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171d789-1950-4deb-9920-ac6a7df9b095 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.431334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474af7-0410-4d50-a4de-00f9a2b2ac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.431962 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474af7-0410-4d50-a4de-00f9a2b2ac1c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.432265 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474af7-0410-4d50-a4de-00f9a2b2ac1c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.432527 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474af7-0410-4d50-a4de-00f9a2b2ac1c None admin] PATH_INFO: `/v3/users/43fd34ae845b4971aa466c4ccd21a58c` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.433679 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a474af7-0410-4d50-a4de-00f9a2b2ac1c None admin] RBAC: Authorizing `identity:get_user(user_id=43fd34ae845b4971aa466c4ccd21a58c)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.435242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 110/221] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:36 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:36.435346 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a474af7-0410-4d50-a4de-00f9a2b2ac1c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.436315 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1d9d-5356-4e97-a620-187f2aa72fec None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.436593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1d9d-5356-4e97-a620-187f2aa72fec None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.436861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1d9d-5356-4e97-a620-187f2aa72fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.441678 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 112/222] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/users/43fd34ae845b4971aa466c4ccd21a58c => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:36.442656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474af7-0410-4d50-a4de-00f9a2b2ac1c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.457301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-5dbc1d9d-5356-4e97-a620-187f2aa72fec None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:36.458537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-5dbc1d9d-5356-4e97-a620-187f2aa72fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:36.540722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 111/223] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:36.541740 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc1d9d-5356-4e97-a620-187f2aa72fec None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.548774 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.566659 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474af7-0410-4d50-a4de-00f9a2b2ac1c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.607043 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c037f-9d16-449f-837e-84705292a421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.607771 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c037f-9d16-449f-837e-84705292a421 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.609385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c037f-9d16-449f-837e-84705292a421 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.609385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c037f-9d16-449f-837e-84705292a421 None admin] PATH_INFO: `/v3/users/36ead9353365434380e310369ccd8566` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.625142 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c037f-9d16-449f-837e-84705292a421 None admin] RBAC: Authorizing `identity:get_user(user_id=36ead9353365434380e310369ccd8566)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.626713 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c037f-9d16-449f-837e-84705292a421 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.628760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 113/224] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/users/36ead9353365434380e310369ccd8566 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:36.634628 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c037f-9d16-449f-837e-84705292a421 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.692706 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.702195 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc1d9d-5356-4e97-a620-187f2aa72fec None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.747527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb832db-8455-4fc6-b091-770b1b3df7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.748204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb832db-8455-4fc6-b091-770b1b3df7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.748478 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb832db-8455-4fc6-b091-770b1b3df7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.748742 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb832db-8455-4fc6-b091-770b1b3df7c4 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.750077 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb832db-8455-4fc6-b091-770b1b3df7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.751527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb832db-8455-4fc6-b091-770b1b3df7c4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.753472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 112/225] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:36.760511 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb832db-8455-4fc6-b091-770b1b3df7c4 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.761773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c037f-9d16-449f-837e-84705292a421 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.817235 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad61623-1bda-4739-88c3-6c22aeec29f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.818077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad61623-1bda-4739-88c3-6c22aeec29f1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.818535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad61623-1bda-4739-88c3-6c22aeec29f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.818937 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad61623-1bda-4739-88c3-6c22aeec29f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.843625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.902312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb832db-8455-4fc6-b091-770b1b3df7c4 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.911106 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad61623-1bda-4739-88c3-6c22aeec29f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.912660 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad61623-1bda-4739-88c3-6c22aeec29f1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.949175 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d74d1-f0c8-470c-831f-5f55939d5b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.950546 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d74d1-f0c8-470c-831f-5f55939d5b07 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.951240 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d74d1-f0c8-470c-831f-5f55939d5b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.952407 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d74d1-f0c8-470c-831f-5f55939d5b07 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b/users/43fd34ae845b4971aa466c4ccd21a58c/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.954286 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d74d1-f0c8-470c-831f-5f55939d5b07 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8531c2d09da496ab76402401d9fc34b, user_id=43fd34ae845b4971aa466c4ccd21a58c, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.955929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d74d1-f0c8-470c-831f-5f55939d5b07 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.974170 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 113/226] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:36 2022] PUT /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b/users/43fd34ae845b4971aa466c4ccd21a58c/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:36.975511 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d74d1-f0c8-470c-831f-5f55939d5b07 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.036440 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:37.072664 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 114/227] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 09 00:42:37.079204 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad61623-1bda-4739-88c3-6c22aeec29f1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.145864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:37.217553 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad61623-1bda-4739-88c3-6c22aeec29f1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.224539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d74d1-f0c8-470c-831f-5f55939d5b07 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.256309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9c54-8237-4ae5-8ade-10a712626137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:37.256946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9c54-8237-4ae5-8ade-10a712626137 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.257217 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9c54-8237-4ae5-8ade-10a712626137 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.257484 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9c54-8237-4ae5-8ade-10a712626137 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.259533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9c54-8237-4ae5-8ade-10a712626137 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:37.261015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9c54-8237-4ae5-8ade-10a712626137 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:37.262954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 115/228] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:37 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:37.267571 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f165f-8ed8-4961-b54c-54c3fcf0416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:37.268797 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f165f-8ed8-4961-b54c-54c3fcf0416f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.268797 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f165f-8ed8-4961-b54c-54c3fcf0416f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.268797 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f165f-8ed8-4961-b54c-54c3fcf0416f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.270586 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9c54-8237-4ae5-8ade-10a712626137 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.280264 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f165f-8ed8-4961-b54c-54c3fcf0416f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-d56f165f-8ed8-4961-b54c-54c3fcf0416f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:37.285154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:37.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:37.286914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 114/229] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:37.292346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f165f-8ed8-4961-b54c-54c3fcf0416f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9c54-8237-4ae5-8ade-10a712626137 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.389551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:37.411591 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9778b-dd00-4299-b174-31049897682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:37.412880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9778b-dd00-4299-b174-31049897682d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.413359 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9778b-dd00-4299-b174-31049897682d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.413824 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9778b-dd00-4299-b174-31049897682d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.414760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9778b-dd00-4299-b174-31049897682d None admin] RBAC: Adding query filter params (role.id=fa4a34a109e44660bbce4320a4c9a366, scope.project.id=f8531c2d09da496ab76402401d9fc34b, user.id=36ead9353365434380e310369ccd8566) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:37.415340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9778b-dd00-4299-b174-31049897682d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:37.416997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9778b-dd00-4299-b174-31049897682d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:37.424494 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 116/230] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:37 2022] GET /identity/v3/role_assignments?user.id=36ead9353365434380e310369ccd8566&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:37.492468 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:37.522804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f165f-8ed8-4961-b54c-54c3fcf0416f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.574861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235d207-0dc8-4125-81e7-91bf5359060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:37.575497 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235d207-0dc8-4125-81e7-91bf5359060c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.575773 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235d207-0dc8-4125-81e7-91bf5359060c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.576034 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235d207-0dc8-4125-81e7-91bf5359060c None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.576734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235d207-0dc8-4125-81e7-91bf5359060c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:37.577033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235d207-0dc8-4125-81e7-91bf5359060c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:37.578446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235d207-0dc8-4125-81e7-91bf5359060c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:37.592081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 115/231] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:37.598140 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9778b-dd00-4299-b174-31049897682d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.768842 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9778b-dd00-4299-b174-31049897682d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.816262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef679a-2d61-471e-8eeb-ac546918b19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:37.817275 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef679a-2d61-471e-8eeb-ac546918b19f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.817743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef679a-2d61-471e-8eeb-ac546918b19f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.818203 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef679a-2d61-471e-8eeb-ac546918b19f None admin] PATH_INFO: `/v3/users/43fd34ae845b4971aa466c4ccd21a58c` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.820768 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef679a-2d61-471e-8eeb-ac546918b19f None admin] RBAC: Authorizing `identity:get_user(user_id=43fd34ae845b4971aa466c4ccd21a58c)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:37.822258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef679a-2d61-471e-8eeb-ac546918b19f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:37.824083 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 117/232] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:37 2022] GET /identity/v3/users/43fd34ae845b4971aa466c4ccd21a58c => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:37.830085 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235d207-0dc8-4125-81e7-91bf5359060c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.953236 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235d207-0dc8-4125-81e7-91bf5359060c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.992095 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf7275-354d-49d9-aa7c-0a83dda9f1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:37.992739 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7275-354d-49d9-aa7c-0a83dda9f1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.993012 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7275-354d-49d9-aa7c-0a83dda9f1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.993279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7275-354d-49d9-aa7c-0a83dda9f1f8 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.996732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf7275-354d-49d9-aa7c-0a83dda9f1f8 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:37.998178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf7275-354d-49d9-aa7c-0a83dda9f1f8 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:38.000193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 116/233] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:37 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:38.006100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef679a-2d61-471e-8eeb-ac546918b19f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.083432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:38.142949 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef679a-2d61-471e-8eeb-ac546918b19f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.187455 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492ddbe-12e2-4cf5-a293-162924df68ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.188195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492ddbe-12e2-4cf5-a293-162924df68ff None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.188474 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492ddbe-12e2-4cf5-a293-162924df68ff None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.188840 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492ddbe-12e2-4cf5-a293-162924df68ff None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b/users/43fd34ae845b4971aa466c4ccd21a58c/roles/d796a9636e044b848ecdc0f80ee9443d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.193740 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492ddbe-12e2-4cf5-a293-162924df68ff None admin] RBAC: Authorizing `identity:create_grant(project_id=f8531c2d09da496ab76402401d9fc34b, user_id=43fd34ae845b4971aa466c4ccd21a58c, role_id=d796a9636e044b848ecdc0f80ee9443d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:38.195212 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492ddbe-12e2-4cf5-a293-162924df68ff None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:38.219814 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 118/234] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:38 2022] PUT /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b/users/43fd34ae845b4971aa466c4ccd21a58c/roles/d796a9636e044b848ecdc0f80ee9443d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:38.994729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81257dfc-7abd-4a42-a641-c43c69e01ac6 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.994729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81257dfc-7abd-4a42-a641-c43c69e01ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.994729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81257dfc-7abd-4a42-a641-c43c69e01ac6 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.994729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 117/235] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:39.000913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11e72-e439-459d-8156-bf6b0ef4ec8f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.001732 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11e72-e439-459d-8156-bf6b0ef4ec8f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.002197 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11e72-e439-459d-8156-bf6b0ef4ec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.022118 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d4f11e72-e439-459d-8156-bf6b0ef4ec8f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:39.023649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d4f11e72-e439-459d-8156-bf6b0ef4ec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:39.097182 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 119/236] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:39.315239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa200-8335-4f9d-98a9-a28473ace631 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.315902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa200-8335-4f9d-98a9-a28473ace631 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.316402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaa200-8335-4f9d-98a9-a28473ace631 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.317956 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 118/237] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:39.323441 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62945c41-8228-4c3c-8758-4ecc6ec2f3aa None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.323991 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62945c41-8228-4c3c-8758-4ecc6ec2f3aa None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.324537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62945c41-8228-4c3c-8758-4ecc6ec2f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.353154 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-62945c41-8228-4c3c-8758-4ecc6ec2f3aa None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:39.354706 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-62945c41-8228-4c3c-8758-4ecc6ec2f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:39.384243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.437378 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 120/238] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:39.476282 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaa200-8335-4f9d-98a9-a28473ace631 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.501426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.619864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaa200-8335-4f9d-98a9-a28473ace631 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.664754 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc7af8-e66a-4db7-9ada-7fd4b73543e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.665406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc7af8-e66a-4db7-9ada-7fd4b73543e8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.665679 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc7af8-e66a-4db7-9ada-7fd4b73543e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.665944 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc7af8-e66a-4db7-9ada-7fd4b73543e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.680279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc7af8-e66a-4db7-9ada-7fd4b73543e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-c7cc7af8-e66a-4db7-9ada-7fd4b73543e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:39.685836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:39.686729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:39.687538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 119/239] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:39.692879 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62945c41-8228-4c3c-8758-4ecc6ec2f3aa None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.823949 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62945c41-8228-4c3c-8758-4ecc6ec2f3aa None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.847733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc7af8-e66a-4db7-9ada-7fd4b73543e8 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.861253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e6b7f-b32a-4c52-8a22-1716b1965612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.862378 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e6b7f-b32a-4c52-8a22-1716b1965612 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.862905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e6b7f-b32a-4c52-8a22-1716b1965612 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.863371 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e6b7f-b32a-4c52-8a22-1716b1965612 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.864396 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e6b7f-b32a-4c52-8a22-1716b1965612 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:39.864942 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e6b7f-b32a-4c52-8a22-1716b1965612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.867049 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e6b7f-b32a-4c52-8a22-1716b1965612 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.877833 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 121/240] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:39.886565 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e6b7f-b32a-4c52-8a22-1716b1965612 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.932204 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.940064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.971173 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc7af8-e66a-4db7-9ada-7fd4b73543e8 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.013840 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59d34a-c4ff-4794-babc-b593d6c174d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.014491 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59d34a-c4ff-4794-babc-b593d6c174d7 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.014751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59d34a-c4ff-4794-babc-b593d6c174d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.015017 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59d34a-c4ff-4794-babc-b593d6c174d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.016794 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59d34a-c4ff-4794-babc-b593d6c174d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.018282 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59d34a-c4ff-4794-babc-b593d6c174d7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.021108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 120/241] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:40.022556 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff6852-258b-4e63-9c84-66b20757eb73 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.022840 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff6852-258b-4e63-9c84-66b20757eb73 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.023113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff6852-258b-4e63-9c84-66b20757eb73 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.024591 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 121/242] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:40.029011 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff6852-258b-4e63-9c84-66b20757eb73 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.051463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e6b7f-b32a-4c52-8a22-1716b1965612 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.086270 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a18af1-5601-4b6e-ac15-d4d04b182a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.086918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18af1-5601-4b6e-ac15-d4d04b182a14 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.087194 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18af1-5601-4b6e-ac15-d4d04b182a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.087509 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18af1-5601-4b6e-ac15-d4d04b182a14 None admin] PATH_INFO: `/v3/users/2907582dad68489699b2f563f2090ff2` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.101962 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a18af1-5601-4b6e-ac15-d4d04b182a14 None admin] RBAC: Authorizing `identity:get_user(user_id=2907582dad68489699b2f563f2090ff2)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.103596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a18af1-5601-4b6e-ac15-d4d04b182a14 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.105515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 122/243] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/users/2907582dad68489699b2f563f2090ff2 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:40.110110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b28de6-75b6-41ef-ac2f-ffc6fae9cd8b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.110110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b28de6-75b6-41ef-ac2f-ffc6fae9cd8b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.110110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b28de6-75b6-41ef-ac2f-ffc6fae9cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.125772 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a0b28de6-75b6-41ef-ac2f-ffc6fae9cd8b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:40.126961 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a0b28de6-75b6-41ef-ac2f-ffc6fae9cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:40.162578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff6852-258b-4e63-9c84-66b20757eb73 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.199523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993bf66-b5c7-43f6-97cb-623eb195728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.200155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993bf66-b5c7-43f6-97cb-623eb195728f None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.200433 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993bf66-b5c7-43f6-97cb-623eb195728f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.200704 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993bf66-b5c7-43f6-97cb-623eb195728f None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.201339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993bf66-b5c7-43f6-97cb-623eb195728f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.202788 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993bf66-b5c7-43f6-97cb-623eb195728f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.202969 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 123/244] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:40.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b28de6-75b6-41ef-ac2f-ffc6fae9cd8b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.220140 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.224155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.243779 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 122/245] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:40 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:40.243779 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1501406-881b-4b08-9b30-3c50311ec3f2 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.243779 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1501406-881b-4b08-9b30-3c50311ec3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.243779 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1501406-881b-4b08-9b30-3c50311ec3f2 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.243779 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 123/246] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:40.258698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513f003-186f-4a76-bfbf-1980fb1819bc None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.259013 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513f003-186f-4a76-bfbf-1980fb1819bc None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.259237 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513f003-186f-4a76-bfbf-1980fb1819bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.300485 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-b513f003-186f-4a76-bfbf-1980fb1819bc None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:40.305074 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-b513f003-186f-4a76-bfbf-1980fb1819bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:40.395743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b28de6-75b6-41ef-ac2f-ffc6fae9cd8b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.399891 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 124/247] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:40.457538 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd2f4f-9dd2-4f9f-9c44-9e06f1c0b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.458508 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd2f4f-9dd2-4f9f-9c44-9e06f1c0b072 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.459033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd2f4f-9dd2-4f9f-9c44-9e06f1c0b072 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.459494 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd2f4f-9dd2-4f9f-9c44-9e06f1c0b072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.489030 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513f003-186f-4a76-bfbf-1980fb1819bc None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.579356 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd2f4f-9dd2-4f9f-9c44-9e06f1c0b072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.581257 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd2f4f-9dd2-4f9f-9c44-9e06f1c0b072 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.601500 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.607408 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513f003-186f-4a76-bfbf-1980fb1819bc None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.639822 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.652424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20afe5-8f5e-444d-be8c-057d79a2bb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.653518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20afe5-8f5e-444d-be8c-057d79a2bb04 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.654055 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20afe5-8f5e-444d-be8c-057d79a2bb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.654627 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20afe5-8f5e-444d-be8c-057d79a2bb04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.666080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20afe5-8f5e-444d-be8c-057d79a2bb04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-4a20afe5-8f5e-444d-be8c-057d79a2bb04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:40.671443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:40.672378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:40.673185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:40.675890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 125/248] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:40.689037 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20afe5-8f5e-444d-be8c-057d79a2bb04 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.710897 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 124/249] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:40.716501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd2f4f-9dd2-4f9f-9c44-9e06f1c0b072 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.804189 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20afe5-8f5e-444d-be8c-057d79a2bb04 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.845734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b70a-4b92-4633-a0a4-32bb4c85d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.846346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b70a-4b92-4633-a0a4-32bb4c85d316 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.846622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b70a-4b92-4633-a0a4-32bb4c85d316 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.846891 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b70a-4b92-4633-a0a4-32bb4c85d316 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.847551 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092b70a-4b92-4633-a0a4-32bb4c85d316 None admin] RBAC: Adding query filter params (name=member) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:40.847846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092b70a-4b92-4633-a0a4-32bb4c85d316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.849252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092b70a-4b92-4633-a0a4-32bb4c85d316 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.858186 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd2f4f-9dd2-4f9f-9c44-9e06f1c0b072 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.858503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 126/250] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:40.859342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b70a-4b92-4633-a0a4-32bb4c85d316 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.875447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e49c59-3023-4b21-918e-8c2a5582edd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.917819 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e49c59-3023-4b21-918e-8c2a5582edd1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.918290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e49c59-3023-4b21-918e-8c2a5582edd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.920574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e49c59-3023-4b21-918e-8c2a5582edd1 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.924651 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e49c59-3023-4b21-918e-8c2a5582edd1 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e49c59-3023-4b21-918e-8c2a5582edd1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.930642 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 125/251] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:40.932264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e49c59-3023-4b21-918e-8c2a5582edd1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.951727 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.027365 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b70a-4b92-4633-a0a4-32bb4c85d316 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.067464 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d753a-ebe4-4a69-b7f1-9d04139e6de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.068365 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d753a-ebe4-4a69-b7f1-9d04139e6de9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.068608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d753a-ebe4-4a69-b7f1-9d04139e6de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.068877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d753a-ebe4-4a69-b7f1-9d04139e6de9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.074160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e49c59-3023-4b21-918e-8c2a5582edd1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.080589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d753a-ebe4-4a69-b7f1-9d04139e6de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-584d753a-ebe4-4a69-b7f1-9d04139e6de9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:41.086899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:41.087804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:41.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 127/252] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:41.092124 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d753a-ebe4-4a69-b7f1-9d04139e6de9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.115014 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a81aa-f416-4fce-9bc7-db187d302687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.115844 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a81aa-f416-4fce-9bc7-db187d302687 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.116244 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a81aa-f416-4fce-9bc7-db187d302687 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.116610 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a81aa-f416-4fce-9bc7-db187d302687 None admin] PATH_INFO: `/v3/users/36ead9353365434380e310369ccd8566` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.118461 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a81aa-f416-4fce-9bc7-db187d302687 None admin] RBAC: Authorizing `identity:get_user(user_id=36ead9353365434380e310369ccd8566)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.120982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a81aa-f416-4fce-9bc7-db187d302687 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.123630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 126/253] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/users/36ead9353365434380e310369ccd8566 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:41.124964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4052a-54bd-43c1-bece-3b62d74de182 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.125340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4052a-54bd-43c1-bece-3b62d74de182 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.125765 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4052a-54bd-43c1-bece-3b62d74de182 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.127438 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 127/254] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:41.128211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4052a-54bd-43c1-bece-3b62d74de182 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.183600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.214686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d753a-ebe4-4a69-b7f1-9d04139e6de9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.224924 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.238112 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4052a-54bd-43c1-bece-3b62d74de182 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.254075 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d38a-3841-43ab-b9a8-6745d3bac2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.254697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d38a-3841-43ab-b9a8-6745d3bac2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.254962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d38a-3841-43ab-b9a8-6745d3bac2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.255226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d38a-3841-43ab-b9a8-6745d3bac2c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.256006 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48d38a-3841-43ab-b9a8-6745d3bac2c4 None admin] RBAC: Adding query filter params (role.id=8fb869cab8f84a7181324bcafe554ba6, scope.project.id=f8531c2d09da496ab76402401d9fc34b, user.id=2907582dad68489699b2f563f2090ff2) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:41.256394 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48d38a-3841-43ab-b9a8-6745d3bac2c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.258892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48d38a-3841-43ab-b9a8-6745d3bac2c4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.265534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 128/255] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/role_assignments?user.id=2907582dad68489699b2f563f2090ff2&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=8fb869cab8f84a7181324bcafe554ba6 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:41.266113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d38a-3841-43ab-b9a8-6745d3bac2c4 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.297813 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91691833-f6fc-4647-9e88-a775719daa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.298362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91691833-f6fc-4647-9e88-a775719daa7c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.298642 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91691833-f6fc-4647-9e88-a775719daa7c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.298907 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91691833-f6fc-4647-9e88-a775719daa7c None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.299576 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91691833-f6fc-4647-9e88-a775719daa7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:41.299874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91691833-f6fc-4647-9e88-a775719daa7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.301298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91691833-f6fc-4647-9e88-a775719daa7c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.326691 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 128/256] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:41.327988 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a12f7-ba46-45b5-a821-ee4edc91c0c4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.328318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a12f7-ba46-45b5-a821-ee4edc91c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.328594 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a12f7-ba46-45b5-a821-ee4edc91c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.373234 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f38a12f7-ba46-45b5-a821-ee4edc91c0c4 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:41.374460 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f38a12f7-ba46-45b5-a821-ee4edc91c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:41.379167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d38a-3841-43ab-b9a8-6745d3bac2c4 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.419272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295d7cb-b258-41fb-b415-d8c3a0fcbd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.419955 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295d7cb-b258-41fb-b415-d8c3a0fcbd17 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.420352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295d7cb-b258-41fb-b415-d8c3a0fcbd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.420563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295d7cb-b258-41fb-b415-d8c3a0fcbd17 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.422201 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295d7cb-b258-41fb-b415-d8c3a0fcbd17 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.423868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295d7cb-b258-41fb-b415-d8c3a0fcbd17 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.425634 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 129/257] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:41.426473 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295d7cb-b258-41fb-b415-d8c3a0fcbd17 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.495273 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.541256 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295d7cb-b258-41fb-b415-d8c3a0fcbd17 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.576656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 129/258] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:41.577222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a12f7-ba46-45b5-a821-ee4edc91c0c4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.584758 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea2d79-7fdb-4ec6-b583-cad81ae294ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.585419 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2d79-7fdb-4ec6-b583-cad81ae294ac None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.585695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2d79-7fdb-4ec6-b583-cad81ae294ac None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.585965 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2d79-7fdb-4ec6-b583-cad81ae294ac None admin] PATH_INFO: `/v3/users/43fd34ae845b4971aa466c4ccd21a58c` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.588750 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea2d79-7fdb-4ec6-b583-cad81ae294ac None admin] RBAC: Authorizing `identity:get_user(user_id=43fd34ae845b4971aa466c4ccd21a58c)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.590503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea2d79-7fdb-4ec6-b583-cad81ae294ac None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.593674 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 130/259] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/users/43fd34ae845b4971aa466c4ccd21a58c => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:41.601783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea2d79-7fdb-4ec6-b583-cad81ae294ac None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.648380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.709531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea2d79-7fdb-4ec6-b583-cad81ae294ac None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.720490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.740780 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a12f7-ba46-45b5-a821-ee4edc91c0c4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.762065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcea40b-40f6-4d26-92ce-82585edf54e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.763028 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcea40b-40f6-4d26-92ce-82585edf54e1 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.763498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcea40b-40f6-4d26-92ce-82585edf54e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.763955 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcea40b-40f6-4d26-92ce-82585edf54e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.821325 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efefaf-fc74-42bc-bb17-dc452d169b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.822011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efefaf-fc74-42bc-bb17-dc452d169b2c None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.822287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efefaf-fc74-42bc-bb17-dc452d169b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.822560 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efefaf-fc74-42bc-bb17-dc452d169b2c None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b/users/36ead9353365434380e310369ccd8566/roles/fa4a34a109e44660bbce4320a4c9a366` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.824574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efefaf-fc74-42bc-bb17-dc452d169b2c None admin] RBAC: Authorizing `identity:create_grant(project_id=f8531c2d09da496ab76402401d9fc34b, user_id=36ead9353365434380e310369ccd8566, role_id=fa4a34a109e44660bbce4320a4c9a366)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.826095 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efefaf-fc74-42bc-bb17-dc452d169b2c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.854360 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 130/260] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:41 2022] PUT /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b/users/36ead9353365434380e310369ccd8566/roles/fa4a34a109e44660bbce4320a4c9a366 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:41.887091 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcea40b-40f6-4d26-92ce-82585edf54e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.888680 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcea40b-40f6-4d26-92ce-82585edf54e1 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:42.019726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 131/261] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:42.026382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efefaf-fc74-42bc-bb17-dc452d169b2c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:42.136708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcea40b-40f6-4d26-92ce-82585edf54e1 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:42.138666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efefaf-fc74-42bc-bb17-dc452d169b2c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:42.140843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:42.152212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:42.175659 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799af58-40b7-4617-bfe9-01080b53001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:42.176340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799af58-40b7-4617-bfe9-01080b53001e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.176617 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799af58-40b7-4617-bfe9-01080b53001e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.176888 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799af58-40b7-4617-bfe9-01080b53001e None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.178140 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799af58-40b7-4617-bfe9-01080b53001e None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:42.179767 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799af58-40b7-4617-bfe9-01080b53001e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:42.181780 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 131/262] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:42 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:42.188365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799af58-40b7-4617-bfe9-01080b53001e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:42.291255 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcea40b-40f6-4d26-92ce-82585edf54e1 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:42.327693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b381d3-71ef-4606-9d34-07981bd9cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:42.328226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b381d3-71ef-4606-9d34-07981bd9cad6 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.328500 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b381d3-71ef-4606-9d34-07981bd9cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.328769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b381d3-71ef-4606-9d34-07981bd9cad6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.340164 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b381d3-71ef-4606-9d34-07981bd9cad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:42.342970 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799af58-40b7-4617-bfe9-01080b53001e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-12b381d3-71ef-4606-9d34-07981bd9cad6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:42.345059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:42.345953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:42.346986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 132/263] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:42.353161 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b381d3-71ef-4606-9d34-07981bd9cad6 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:42.387022 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5909aa-bda1-4a69-98bc-ecd0c38c7b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:42.387871 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5909aa-bda1-4a69-98bc-ecd0c38c7b54 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.388436 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5909aa-bda1-4a69-98bc-ecd0c38c7b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.388962 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5909aa-bda1-4a69-98bc-ecd0c38c7b54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.389818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5909aa-bda1-4a69-98bc-ecd0c38c7b54 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=f8531c2d09da496ab76402401d9fc34b, user.id=43fd34ae845b4971aa466c4ccd21a58c) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:42.390502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5909aa-bda1-4a69-98bc-ecd0c38c7b54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:42.392100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5909aa-bda1-4a69-98bc-ecd0c38c7b54 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:42.399543 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 132/264] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:42 2022] GET /identity/v3/role_assignments?user.id=43fd34ae845b4971aa466c4ccd21a58c&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:42.478004 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:42.522896 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b381d3-71ef-4606-9d34-07981bd9cad6 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:42.564388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6856-60a5-44dc-9dc9-d287c8fc6f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:42.565081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6856-60a5-44dc-9dc9-d287c8fc6f5a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.565359 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6856-60a5-44dc-9dc9-d287c8fc6f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.565630 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6856-60a5-44dc-9dc9-d287c8fc6f5a None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.566316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6856-60a5-44dc-9dc9-d287c8fc6f5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:42.566620 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6856-60a5-44dc-9dc9-d287c8fc6f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:42.568033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6856-60a5-44dc-9dc9-d287c8fc6f5a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:42.580463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 133/265] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:42.586478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5909aa-bda1-4a69-98bc-ecd0c38c7b54 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:42.639494 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:42.715163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5909aa-bda1-4a69-98bc-ecd0c38c7b54 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:42.755466 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96371af3-43ea-497f-bb69-2276f1da81e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:42.756599 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371af3-43ea-497f-bb69-2276f1da81e1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.757071 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371af3-43ea-497f-bb69-2276f1da81e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.757859 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371af3-43ea-497f-bb69-2276f1da81e1 None admin] PATH_INFO: `/v3/users/43fd34ae845b4971aa466c4ccd21a58c` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.759206 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96371af3-43ea-497f-bb69-2276f1da81e1 None admin] RBAC: Authorizing `identity:get_user(user_id=43fd34ae845b4971aa466c4ccd21a58c)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:42.760891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96371af3-43ea-497f-bb69-2276f1da81e1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:42.762666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 133/266] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:42 2022] GET /identity/v3/users/43fd34ae845b4971aa466c4ccd21a58c => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:42.768367 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6856-60a5-44dc-9dc9-d287c8fc6f5a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:42.901515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6856-60a5-44dc-9dc9-d287c8fc6f5a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:42.931462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:42.937044 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813e426-afb4-48b0-afb6-f6dbe8c33741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:42.937713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813e426-afb4-48b0-afb6-f6dbe8c33741 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.938267 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813e426-afb4-48b0-afb6-f6dbe8c33741 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.938462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813e426-afb4-48b0-afb6-f6dbe8c33741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.010936 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813e426-afb4-48b0-afb6-f6dbe8c33741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:43.012497 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813e426-afb4-48b0-afb6-f6dbe8c33741 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:43.116275 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 134/267] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:43.121554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96371af3-43ea-497f-bb69-2276f1da81e1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:43.259493 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96371af3-43ea-497f-bb69-2276f1da81e1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:43.261098 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:43.296106 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f451a1-e312-4be8-9dbb-6d51fc4cd233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:43.296914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f451a1-e312-4be8-9dbb-6d51fc4cd233 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.297284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f451a1-e312-4be8-9dbb-6d51fc4cd233 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.297645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f451a1-e312-4be8-9dbb-6d51fc4cd233 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.298975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f451a1-e312-4be8-9dbb-6d51fc4cd233 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:43.300576 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f451a1-e312-4be8-9dbb-6d51fc4cd233 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:43.302591 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 134/268] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:43 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:43.308624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813e426-afb4-48b0-afb6-f6dbe8c33741 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:43.350212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:43.438408 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813e426-afb4-48b0-afb6-f6dbe8c33741 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:43.454372 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49b522-fa96-400f-ae86-79d6d7eea17c None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.454643 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49b522-fa96-400f-ae86-79d6d7eea17c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.454912 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49b522-fa96-400f-ae86-79d6d7eea17c None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.456495 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 135/269] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:43.461419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea2b4c-4ec1-4ec3-b691-47487b7c7a2f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.461692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea2b4c-4ec1-4ec3-b691-47487b7c7a2f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.461957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea2b4c-4ec1-4ec3-b691-47487b7c7a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.486077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9eea2b4c-4ec1-4ec3-b691-47487b7c7a2f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:43.487264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9eea2b4c-4ec1-4ec3-b691-47487b7c7a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:43.509657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da803108-f4c5-4fb0-bacf-72cf0ab880a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:43.510198 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da803108-f4c5-4fb0-bacf-72cf0ab880a3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.510471 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da803108-f4c5-4fb0-bacf-72cf0ab880a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.510739 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da803108-f4c5-4fb0-bacf-72cf0ab880a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.511455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da803108-f4c5-4fb0-bacf-72cf0ab880a3 None admin] RBAC: Adding query filter params (role.id=d796a9636e044b848ecdc0f80ee9443d, scope.project.id=f8531c2d09da496ab76402401d9fc34b, user.id=43fd34ae845b4971aa466c4ccd21a58c) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:43.511757 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da803108-f4c5-4fb0-bacf-72cf0ab880a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:43.513233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da803108-f4c5-4fb0-bacf-72cf0ab880a3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:43.532163 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 135/270] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:43 2022] GET /identity/v3/role_assignments?user.id=43fd34ae845b4971aa466c4ccd21a58c&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=d796a9636e044b848ecdc0f80ee9443d => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:43.588363 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 136/271] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 09 00:42:43.816803 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b4fdc-34ba-43f2-98c5-e2cf899f2107 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b4fdc-34ba-43f2-98c5-e2cf899f2107 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.817354 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b4fdc-34ba-43f2-98c5-e2cf899f2107 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.818918 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 136/272] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:43.824486 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54902a-cfa3-4a39-b940-2430e16976ff None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.824799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54902a-cfa3-4a39-b940-2430e16976ff None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.825072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54902a-cfa3-4a39-b940-2430e16976ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.844341 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-3e54902a-cfa3-4a39-b940-2430e16976ff None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:43.845528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3e54902a-cfa3-4a39-b940-2430e16976ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:43.877184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b4fdc-34ba-43f2-98c5-e2cf899f2107 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:43.921459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 137/273] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:43.993647 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.001541 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b4fdc-34ba-43f2-98c5-e2cf899f2107 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56405454-e7cf-4e37-82cf-10ee6a029cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.039639 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405454-e7cf-4e37-82cf-10ee6a029cee None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.039915 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405454-e7cf-4e37-82cf-10ee6a029cee None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.040224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56405454-e7cf-4e37-82cf-10ee6a029cee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.041368 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56405454-e7cf-4e37-82cf-10ee6a029cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:44.042873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56405454-e7cf-4e37-82cf-10ee6a029cee None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:44.044755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 137/274] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:44.051643 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54902a-cfa3-4a39-b940-2430e16976ff None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.087314 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.163860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54902a-cfa3-4a39-b940-2430e16976ff None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.202692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59da5f-5277-452f-8390-194e91a3ae4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.203303 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59da5f-5277-452f-8390-194e91a3ae4c None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.203576 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59da5f-5277-452f-8390-194e91a3ae4c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.203843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59da5f-5277-452f-8390-194e91a3ae4c None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.204609 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59da5f-5277-452f-8390-194e91a3ae4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:44.206067 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59da5f-5277-452f-8390-194e91a3ae4c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:44.216837 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56405454-e7cf-4e37-82cf-10ee6a029cee None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.236118 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 138/275] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:44 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:44.353840 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56405454-e7cf-4e37-82cf-10ee6a029cee None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.366946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbf1f7-c10f-4209-b000-6fd9cbbe13aa None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.367504 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbf1f7-c10f-4209-b000-6fd9cbbe13aa None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.367504 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbf1f7-c10f-4209-b000-6fd9cbbe13aa None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.369108 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 139/276] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:44.375631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d096c-6e24-4616-8ef2-1a2cce2eda92 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.376545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d096c-6e24-4616-8ef2-1a2cce2eda92 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.377129 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d096c-6e24-4616-8ef2-1a2cce2eda92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.400438 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb4725-2cce-48f1-b685-6ba42114a11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.401084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb4725-2cce-48f1-b685-6ba42114a11f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.401356 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb4725-2cce-48f1-b685-6ba42114a11f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.401619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb4725-2cce-48f1-b685-6ba42114a11f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.402390 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8b7d096c-6e24-4616-8ef2-1a2cce2eda92 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:44.404171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8b7d096c-6e24-4616-8ef2-1a2cce2eda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:44.420211 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb4725-2cce-48f1-b685-6ba42114a11f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-efcb4725-2cce-48f1-b685-6ba42114a11f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:44.426686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:44.428258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:44.429243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:44.429912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 138/277] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:44.435578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb4725-2cce-48f1-b685-6ba42114a11f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.467494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.499837 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 140/278] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:44.556921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb4725-2cce-48f1-b685-6ba42114a11f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.593701 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff779ae-8fd5-44ca-942b-3d31036e110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.594697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff779ae-8fd5-44ca-942b-3d31036e110d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.595171 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff779ae-8fd5-44ca-942b-3d31036e110d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.595727 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff779ae-8fd5-44ca-942b-3d31036e110d None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.596688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff779ae-8fd5-44ca-942b-3d31036e110d None admin] RBAC: Adding query filter params (name=member) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:44.597220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff779ae-8fd5-44ca-942b-3d31036e110d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:44.598893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff779ae-8fd5-44ca-942b-3d31036e110d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:44.609605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 139/279] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:44.615303 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d096c-6e24-4616-8ef2-1a2cce2eda92 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.717313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356550d-12f5-41d1-8f6c-5051fe6f698e None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.717973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356550d-12f5-41d1-8f6c-5051fe6f698e None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.718460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356550d-12f5-41d1-8f6c-5051fe6f698e None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.720124 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 140/280] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:44.725670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5481-2203-4958-8311-b3b1d243c233 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.726257 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5481-2203-4958-8311-b3b1d243c233 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.726751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5481-2203-4958-8311-b3b1d243c233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.731131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d096c-6e24-4616-8ef2-1a2cce2eda92 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.755573 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-654e5481-2203-4958-8311-b3b1d243c233 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:44.756867 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-654e5481-2203-4958-8311-b3b1d243c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:44.775918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29151431-5cb4-4900-8930-58d3fdaa29de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.776601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29151431-5cb4-4900-8930-58d3fdaa29de None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.776877 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29151431-5cb4-4900-8930-58d3fdaa29de None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.777146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29151431-5cb4-4900-8930-58d3fdaa29de None admin] PATH_INFO: `/v3/users/02c42b66bfc14e408cf921a6070d7722` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.806174 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29151431-5cb4-4900-8930-58d3fdaa29de None admin] RBAC: Authorizing `identity:get_user(user_id=02c42b66bfc14e408cf921a6070d7722)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:44.808206 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29151431-5cb4-4900-8930-58d3fdaa29de None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:44.810724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 141/281] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:44 2022] GET /identity/v3/users/02c42b66bfc14e408cf921a6070d7722 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:44.812851 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29151431-5cb4-4900-8930-58d3fdaa29de None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.860375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 141/282] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:44.861438 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e5481-2203-4958-8311-b3b1d243c233 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.880554 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.916718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29151431-5cb4-4900-8930-58d3fdaa29de None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.928397 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.966541 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7012e4-5f71-4fbc-b7d1-92c78dd9b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.967188 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7012e4-5f71-4fbc-b7d1-92c78dd9b3bf None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.967460 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7012e4-5f71-4fbc-b7d1-92c78dd9b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.967724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7012e4-5f71-4fbc-b7d1-92c78dd9b3bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.991908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7012e4-5f71-4fbc-b7d1-92c78dd9b3bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-1f7012e4-5f71-4fbc-b7d1-92c78dd9b3bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:45.000635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:45.001588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:45.002649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 142/283] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:45.008619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7012e4-5f71-4fbc-b7d1-92c78dd9b3bf None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.025657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e5481-2203-4958-8311-b3b1d243c233 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.094774 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d65827-d55a-4ca2-ad19-d6824ba5a809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.095387 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d65827-d55a-4ca2-ad19-d6824ba5a809 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.095660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d65827-d55a-4ca2-ad19-d6824ba5a809 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.095924 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d65827-d55a-4ca2-ad19-d6824ba5a809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.096668 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d65827-d55a-4ca2-ad19-d6824ba5a809 None admin] RBAC: Adding query filter params (role.id=fa4a34a109e44660bbce4320a4c9a366, user.id=02c42b66bfc14e408cf921a6070d7722, scope.system=all) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:45.096967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d65827-d55a-4ca2-ad19-d6824ba5a809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:45.098421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d65827-d55a-4ca2-ad19-d6824ba5a809 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:45.110702 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 142/284] 10.222.0.43 () {56 vars in 1308 bytes} [Sun Oct 9 00:42:44 2022] GET /identity/v3/role_assignments?user.id=02c42b66bfc14e408cf921a6070d7722&scope.system=all&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:45.158449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7012e4-5f71-4fbc-b7d1-92c78dd9b3bf None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.174409 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d65827-d55a-4ca2-ad19-d6824ba5a809 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.213390 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edff08-bf54-471c-a76f-16b8e035bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.214007 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edff08-bf54-471c-a76f-16b8e035bae0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.214283 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edff08-bf54-471c-a76f-16b8e035bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.214553 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edff08-bf54-471c-a76f-16b8e035bae0 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.218792 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edff08-bf54-471c-a76f-16b8e035bae0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:45.219100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edff08-bf54-471c-a76f-16b8e035bae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:45.220568 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edff08-bf54-471c-a76f-16b8e035bae0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:45.225987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:45.249550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 143/285] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:45.258302 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edff08-bf54-471c-a76f-16b8e035bae0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.346429 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:45.398843 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d65827-d55a-4ca2-ad19-d6824ba5a809 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.421233 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edff08-bf54-471c-a76f-16b8e035bae0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.464482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39770af9-ebb9-4566-99fa-ea92419b8154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.466179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39770af9-ebb9-4566-99fa-ea92419b8154 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.467004 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39770af9-ebb9-4566-99fa-ea92419b8154 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.467941 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39770af9-ebb9-4566-99fa-ea92419b8154 None admin] PATH_INFO: `/v3/users/2907582dad68489699b2f563f2090ff2` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.470075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39770af9-ebb9-4566-99fa-ea92419b8154 None admin] RBAC: Authorizing `identity:get_user(user_id=2907582dad68489699b2f563f2090ff2)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:45.472034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39770af9-ebb9-4566-99fa-ea92419b8154 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:45.474514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94dcaf-a325-4a30-85b4-6248e6e9217d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.475380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94dcaf-a325-4a30-85b4-6248e6e9217d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.475845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94dcaf-a325-4a30-85b4-6248e6e9217d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.476334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94dcaf-a325-4a30-85b4-6248e6e9217d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.479154 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 144/286] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/users/2907582dad68489699b2f563f2090ff2 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:45.483301 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39770af9-ebb9-4566-99fa-ea92419b8154 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.506003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94dcaf-a325-4a30-85b4-6248e6e9217d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-0c94dcaf-a325-4a30-85b4-6248e6e9217d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:45.511755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:45.512795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:45.513605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:45.516417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 143/287] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:45.522082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94dcaf-a325-4a30-85b4-6248e6e9217d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.610710 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:45.689203 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94dcaf-a325-4a30-85b4-6248e6e9217d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.699347 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39770af9-ebb9-4566-99fa-ea92419b8154 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.729139 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa15e53-7da4-4a85-b21e-b9af9d2d158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.729742 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15e53-7da4-4a85-b21e-b9af9d2d158c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.730012 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15e53-7da4-4a85-b21e-b9af9d2d158c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.730273 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15e53-7da4-4a85-b21e-b9af9d2d158c None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.730924 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa15e53-7da4-4a85-b21e-b9af9d2d158c None admin] RBAC: Adding query filter params (name=member) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:45.731214 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa15e53-7da4-4a85-b21e-b9af9d2d158c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:45.735415 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa15e53-7da4-4a85-b21e-b9af9d2d158c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:45.746719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:45.755534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 144/288] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:45.761842 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa15e53-7da4-4a85-b21e-b9af9d2d158c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.774767 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcdf0c-fc7e-49e4-b291-2778c3ec8c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.775422 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcdf0c-fc7e-49e4-b291-2778c3ec8c3d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.775696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcdf0c-fc7e-49e4-b291-2778c3ec8c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.775964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcdf0c-fc7e-49e4-b291-2778c3ec8c3d None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.777120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcdf0c-fc7e-49e4-b291-2778c3ec8c3d None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:45.778565 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcdf0c-fc7e-49e4-b291-2778c3ec8c3d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:45.784791 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 145/289] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:45.786848 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcdf0c-fc7e-49e4-b291-2778c3ec8c3d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.908976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa15e53-7da4-4a85-b21e-b9af9d2d158c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.926931 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcdf0c-fc7e-49e4-b291-2778c3ec8c3d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.947343 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9f8c0-a45e-45f7-816a-51de85adcec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.948795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f8c0-a45e-45f7-816a-51de85adcec6 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.949266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f8c0-a45e-45f7-816a-51de85adcec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.949720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f8c0-a45e-45f7-816a-51de85adcec6 None admin] PATH_INFO: `/v3/users/36ead9353365434380e310369ccd8566` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.951068 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9f8c0-a45e-45f7-816a-51de85adcec6 None admin] RBAC: Authorizing `identity:get_user(user_id=36ead9353365434380e310369ccd8566)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:45.952894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9f8c0-a45e-45f7-816a-51de85adcec6 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:45.955025 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 145/290] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/users/36ead9353365434380e310369ccd8566 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:45.960346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9f8c0-a45e-45f7-816a-51de85adcec6 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.990391 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:46.012720 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef9abf-a843-424f-bedf-0709afc84bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.013658 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9abf-a843-424f-bedf-0709afc84bb7 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.014103 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9abf-a843-424f-bedf-0709afc84bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.014514 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9abf-a843-424f-bedf-0709afc84bb7 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b/users/2907582dad68489699b2f563f2090ff2/roles/8fb869cab8f84a7181324bcafe554ba6` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.021560 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef9abf-a843-424f-bedf-0709afc84bb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8531c2d09da496ab76402401d9fc34b, user_id=2907582dad68489699b2f563f2090ff2, role_id=8fb869cab8f84a7181324bcafe554ba6)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.023238 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef9abf-a843-424f-bedf-0709afc84bb7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.036687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:46.062215 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 146/291] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:45 2022] PUT /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b/users/2907582dad68489699b2f563f2090ff2/roles/8fb869cab8f84a7181324bcafe554ba6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:46.084178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9f8c0-a45e-45f7-816a-51de85adcec6 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.137752 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca434de-7655-4a98-babd-23ebb97ada11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.138378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca434de-7655-4a98-babd-23ebb97ada11 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.138651 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca434de-7655-4a98-babd-23ebb97ada11 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.138919 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca434de-7655-4a98-babd-23ebb97ada11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.214102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca434de-7655-4a98-babd-23ebb97ada11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.215537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca434de-7655-4a98-babd-23ebb97ada11 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.292436 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:46.328919 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 146/292] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:46.335279 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef9abf-a843-424f-bedf-0709afc84bb7 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:46.455838 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef9abf-a843-424f-bedf-0709afc84bb7 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.493064 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b7e54-b461-4924-9e4f-11e26c6d2d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.493704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b7e54-b461-4924-9e4f-11e26c6d2d8c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.493983 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b7e54-b461-4924-9e4f-11e26c6d2d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.494254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b7e54-b461-4924-9e4f-11e26c6d2d8c None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.495437 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b7e54-b461-4924-9e4f-11e26c6d2d8c None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.496919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b7e54-b461-4924-9e4f-11e26c6d2d8c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.498568 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 147/293] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:46.504785 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca434de-7655-4a98-babd-23ebb97ada11 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:46.606990 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca434de-7655-4a98-babd-23ebb97ada11 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.643096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68ae96-9c18-49d8-916c-63efab9e405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.643767 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68ae96-9c18-49d8-916c-63efab9e405d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.644065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68ae96-9c18-49d8-916c-63efab9e405d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.644350 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68ae96-9c18-49d8-916c-63efab9e405d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.645200 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68ae96-9c18-49d8-916c-63efab9e405d None admin] RBAC: Adding query filter params (role.id=fa4a34a109e44660bbce4320a4c9a366, scope.project.id=f8531c2d09da496ab76402401d9fc34b, user.id=36ead9353365434380e310369ccd8566) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:46.645505 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68ae96-9c18-49d8-916c-63efab9e405d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.647282 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68ae96-9c18-49d8-916c-63efab9e405d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.653437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 147/294] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/role_assignments?user.id=36ead9353365434380e310369ccd8566&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:46.985779 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdcd2e-8044-4428-b70e-d6567b8c2a33 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.986147 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdcd2e-8044-4428-b70e-d6567b8c2a33 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.986324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdcd2e-8044-4428-b70e-d6567b8c2a33 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.987819 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 148/295] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:46.993329 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe96810-56ff-452e-96bc-9ced75ddea43 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.993862 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe96810-56ff-452e-96bc-9ced75ddea43 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.994335 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe96810-56ff-452e-96bc-9ced75ddea43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.014149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-abe96810-56ff-452e-96bc-9ced75ddea43 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:47.015689 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-abe96810-56ff-452e-96bc-9ced75ddea43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:47.045329 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.094416 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 148/296] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:47.172276 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fdee5-c5e2-4bd7-8d36-b91928f733ca None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.172586 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fdee5-c5e2-4bd7-8d36-b91928f733ca None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.172820 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fdee5-c5e2-4bd7-8d36-b91928f733ca None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.174167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 149/297] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:47.179830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c195-3d29-4966-8f31-3c3bd033025f None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.180426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c195-3d29-4966-8f31-3c3bd033025f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.180950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c195-3d29-4966-8f31-3c3bd033025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.202918 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-67f6c195-3d29-4966-8f31-3c3bd033025f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:47.204500 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-67f6c195-3d29-4966-8f31-3c3bd033025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:47.288638 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 149/298] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:47.380287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fdee5-c5e2-4bd7-8d36-b91928f733ca None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.443649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.491452 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fdee5-c5e2-4bd7-8d36-b91928f733ca None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.529934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907171f-0f60-4218-8d20-5876005ca758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.530571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907171f-0f60-4218-8d20-5876005ca758 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.530842 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907171f-0f60-4218-8d20-5876005ca758 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.531109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907171f-0f60-4218-8d20-5876005ca758 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.532223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907171f-0f60-4218-8d20-5876005ca758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:47.533658 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907171f-0f60-4218-8d20-5876005ca758 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:47.535762 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 150/299] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:47.541477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6c195-3d29-4966-8f31-3c3bd033025f None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.572155 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907171f-0f60-4218-8d20-5876005ca758 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.649395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.658232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6c195-3d29-4966-8f31-3c3bd033025f None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.685330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907171f-0f60-4218-8d20-5876005ca758 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.695598 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae9a43-6f98-4208-9c2d-cfab82bbe75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.696248 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae9a43-6f98-4208-9c2d-cfab82bbe75e None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.696512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae9a43-6f98-4208-9c2d-cfab82bbe75e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.696806 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae9a43-6f98-4208-9c2d-cfab82bbe75e None admin] PATH_INFO: `/v3/groups` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.697431 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae9a43-6f98-4208-9c2d-cfab82bbe75e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:47.698857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae9a43-6f98-4208-9c2d-cfab82bbe75e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:47.716099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 150/300] 10.222.0.43 () {60 vars in 1134 bytes} [Sun Oct 9 00:42:47 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:47.716293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.716556 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358655-1bf9-40db-832f-7da27ffc515a None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.717151 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358655-1bf9-40db-832f-7da27ffc515a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.717473 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358655-1bf9-40db-832f-7da27ffc515a None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.719027 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 151/301] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:47.724974 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0c8f9-cd4b-4dee-8721-ec9f4d11c3fa None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.725534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0c8f9-cd4b-4dee-8721-ec9f4d11c3fa None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.725800 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0c8f9-cd4b-4dee-8721-ec9f4d11c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.736456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc4d5d-acfd-4ea2-8499-1f458b76c432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.737664 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc4d5d-acfd-4ea2-8499-1f458b76c432 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.738151 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc4d5d-acfd-4ea2-8499-1f458b76c432 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.738667 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc4d5d-acfd-4ea2-8499-1f458b76c432 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.745163 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-f3b0c8f9-cd4b-4dee-8721-ec9f4d11c3fa None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:47.746630 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-f3b0c8f9-cd4b-4dee-8721-ec9f4d11c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:47.756241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc4d5d-acfd-4ea2-8499-1f458b76c432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-c6cc4d5d-acfd-4ea2-8499-1f458b76c432 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:47.764761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:47.765735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:47.766550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:47.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 151/302] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:47.775856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc4d5d-acfd-4ea2-8499-1f458b76c432 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.839510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 152/303] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:47.906487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc4d5d-acfd-4ea2-8499-1f458b76c432 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.943490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc271d2-f1bf-46b9-be74-45bd5812d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.944224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc271d2-f1bf-46b9-be74-45bd5812d6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.944501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc271d2-f1bf-46b9-be74-45bd5812d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.944772 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc271d2-f1bf-46b9-be74-45bd5812d6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.945433 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc271d2-f1bf-46b9-be74-45bd5812d6e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:47.945729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc271d2-f1bf-46b9-be74-45bd5812d6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:47.947141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc271d2-f1bf-46b9-be74-45bd5812d6e5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:47.955537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 152/304] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:47.961754 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0c8f9-cd4b-4dee-8721-ec9f4d11c3fa None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.048865 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.070085 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0c8f9-cd4b-4dee-8721-ec9f4d11c3fa None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.105632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7674f-e768-465d-b5d7-3892271378cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.106272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7674f-e768-465d-b5d7-3892271378cb None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.106546 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7674f-e768-465d-b5d7-3892271378cb None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.106811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7674f-e768-465d-b5d7-3892271378cb None admin] PATH_INFO: `/v3/users/a208072657384fac93a18ab1a6a6661d` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.114415 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc271d2-f1bf-46b9-be74-45bd5812d6e5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.123322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7674f-e768-465d-b5d7-3892271378cb None admin] RBAC: Authorizing `identity:get_user(user_id=a208072657384fac93a18ab1a6a6661d)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.124837 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7674f-e768-465d-b5d7-3892271378cb None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.126934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 153/305] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:47 2022] GET /identity/v3/users/a208072657384fac93a18ab1a6a6661d => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:48.134230 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7674f-e768-465d-b5d7-3892271378cb None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.176512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.235361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc271d2-f1bf-46b9-be74-45bd5812d6e5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.248282 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7674f-e768-465d-b5d7-3892271378cb None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.273312 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19022716-547f-472b-aeac-ffca5e1fb5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.274227 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022716-547f-472b-aeac-ffca5e1fb5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.274663 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022716-547f-472b-aeac-ffca5e1fb5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.275076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022716-547f-472b-aeac-ffca5e1fb5e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.284730 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3e6d-d89c-410d-9fb3-ea3ce0a8ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.285424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3e6d-d89c-410d-9fb3-ea3ce0a8ec03 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.285775 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3e6d-d89c-410d-9fb3-ea3ce0a8ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.286086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3e6d-d89c-410d-9fb3-ea3ce0a8ec03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.286880 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c3e6d-d89c-410d-9fb3-ea3ce0a8ec03 None admin] RBAC: Adding query filter params (role.id=8fb869cab8f84a7181324bcafe554ba6, user.id=a208072657384fac93a18ab1a6a6661d, scope.system=all) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:48.287099 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19022716-547f-472b-aeac-ffca5e1fb5e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:48.287383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c3e6d-d89c-410d-9fb3-ea3ce0a8ec03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.288948 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c3e6d-d89c-410d-9fb3-ea3ce0a8ec03 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-19022716-547f-472b-aeac-ffca5e1fb5e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:48.293448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:48.294386 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:48.295223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:48.295851 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 154/306] 10.222.0.43 () {56 vars in 1308 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/role_assignments?user.id=a208072657384fac93a18ab1a6a6661d&scope.system=all&role.id=8fb869cab8f84a7181324bcafe554ba6 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:48.302337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 153/307] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:48.309439 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3e6d-d89c-410d-9fb3-ea3ce0a8ec03 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.313902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.422026 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3e6d-d89c-410d-9fb3-ea3ce0a8ec03 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.460266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82401f0b-1815-4bf5-8a11-c7c2db795757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.460800 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82401f0b-1815-4bf5-8a11-c7c2db795757 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.461069 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82401f0b-1815-4bf5-8a11-c7c2db795757 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.461333 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82401f0b-1815-4bf5-8a11-c7c2db795757 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.461992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82401f0b-1815-4bf5-8a11-c7c2db795757 None admin] RBAC: Adding query filter params (name=member) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:48.462349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82401f0b-1815-4bf5-8a11-c7c2db795757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.463781 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82401f0b-1815-4bf5-8a11-c7c2db795757 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.472885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 155/308] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:48.479498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19022716-547f-472b-aeac-ffca5e1fb5e6 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.591648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19022716-547f-472b-aeac-ffca5e1fb5e6 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.603692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.625595 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bebb8-2865-4411-b5e6-ef6097c55157 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.626140 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bebb8-2865-4411-b5e6-ef6097c55157 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.626217 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bebb8-2865-4411-b5e6-ef6097c55157 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.627787 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 156/309] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:48.628900 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce50bb-026b-4d44-8b52-4f6e64027fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.629538 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce50bb-026b-4d44-8b52-4f6e64027fac None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.629812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce50bb-026b-4d44-8b52-4f6e64027fac None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.630080 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce50bb-026b-4d44-8b52-4f6e64027fac None admin] PATH_INFO: `/v3/users/02c42b66bfc14e408cf921a6070d7722` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.633072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce50bb-026b-4d44-8b52-4f6e64027fac None admin] RBAC: Authorizing `identity:get_user(user_id=02c42b66bfc14e408cf921a6070d7722)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.634593 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce50bb-026b-4d44-8b52-4f6e64027fac None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.636252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185eb1b-30ce-4608-87fb-9a622c22d9ae None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.636508 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 154/310] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/users/02c42b66bfc14e408cf921a6070d7722 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:48.636608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185eb1b-30ce-4608-87fb-9a622c22d9ae None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.636788 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185eb1b-30ce-4608-87fb-9a622c22d9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.642991 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce50bb-026b-4d44-8b52-4f6e64027fac None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.657092 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-a185eb1b-30ce-4608-87fb-9a622c22d9ae None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:48.658269 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-a185eb1b-30ce-4608-87fb-9a622c22d9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:48.728100 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.740907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 157/311] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:48.777562 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce50bb-026b-4d44-8b52-4f6e64027fac None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.812511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae0285-b253-4655-8d55-359fcceffcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.813571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae0285-b253-4655-8d55-359fcceffcd3 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.813901 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae0285-b253-4655-8d55-359fcceffcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.814179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae0285-b253-4655-8d55-359fcceffcd3 None admin] PATH_INFO: `/v3/system/users/02c42b66bfc14e408cf921a6070d7722/roles/fa4a34a109e44660bbce4320a4c9a366` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.815639 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae0285-b253-4655-8d55-359fcceffcd3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=02c42b66bfc14e408cf921a6070d7722, role_id=fa4a34a109e44660bbce4320a4c9a366)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.817060 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae0285-b253-4655-8d55-359fcceffcd3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.827975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 155/312] 10.222.0.43 () {58 vars in 1334 bytes} [Sun Oct 9 00:42:48 2022] PUT /identity/v3/system/users/02c42b66bfc14e408cf921a6070d7722/roles/fa4a34a109e44660bbce4320a4c9a366 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:42:49.011600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185eb1b-30ce-4608-87fb-9a622c22d9ae None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.118556 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185eb1b-30ce-4608-87fb-9a622c22d9ae None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.154060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121159a8-e0cc-4141-b636-a749bf902331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.154692 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121159a8-e0cc-4141-b636-a749bf902331 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121159a8-e0cc-4141-b636-a749bf902331 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.155241 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121159a8-e0cc-4141-b636-a749bf902331 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.165823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121159a8-e0cc-4141-b636-a749bf902331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-121159a8-e0cc-4141-b636-a749bf902331 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:49.170681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:49.171567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:49.172427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 158/313] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:49.180140 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae0285-b253-4655-8d55-359fcceffcd3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.228885 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae0285-b253-4655-8d55-359fcceffcd3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.329824 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb5652-108e-4bf5-a5f7-aea2dd53cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.330427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb5652-108e-4bf5-a5f7-aea2dd53cb71 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.330700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb5652-108e-4bf5-a5f7-aea2dd53cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.330966 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb5652-108e-4bf5-a5f7-aea2dd53cb71 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.331617 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb5652-108e-4bf5-a5f7-aea2dd53cb71 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:49.331910 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb5652-108e-4bf5-a5f7-aea2dd53cb71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.333318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb5652-108e-4bf5-a5f7-aea2dd53cb71 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.342372 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 156/314] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:49.349396 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121159a8-e0cc-4141-b636-a749bf902331 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.408670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.455113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121159a8-e0cc-4141-b636-a749bf902331 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.490093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7cd2c-727a-486d-8e1d-9e388c4ae5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.491274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cd2c-727a-486d-8e1d-9e388c4ae5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.491747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cd2c-727a-486d-8e1d-9e388c4ae5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.492239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cd2c-727a-486d-8e1d-9e388c4ae5a7 None admin] PATH_INFO: `/v3/users/2907582dad68489699b2f563f2090ff2` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.493564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7cd2c-727a-486d-8e1d-9e388c4ae5a7 None admin] RBAC: Authorizing `identity:get_user(user_id=2907582dad68489699b2f563f2090ff2)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.495208 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7cd2c-727a-486d-8e1d-9e388c4ae5a7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.497453 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 159/315] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/users/2907582dad68489699b2f563f2090ff2 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:49.503243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb5652-108e-4bf5-a5f7-aea2dd53cb71 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.607223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb5652-108e-4bf5-a5f7-aea2dd53cb71 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.610449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.645310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa1cd9-4dd3-4231-b485-cf93747e2730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.646388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1cd9-4dd3-4231-b485-cf93747e2730 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.646945 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1cd9-4dd3-4231-b485-cf93747e2730 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.647470 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1cd9-4dd3-4231-b485-cf93747e2730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.716072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa1cd9-4dd3-4231-b485-cf93747e2730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.717562 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa1cd9-4dd3-4231-b485-cf93747e2730 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.823190 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 157/316] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:49.829224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7cd2c-727a-486d-8e1d-9e388c4ae5a7 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.931318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7cd2c-727a-486d-8e1d-9e388c4ae5a7 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.957716 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.971118 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d6be0-05fd-40ba-a856-5a102dc6cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.972257 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d6be0-05fd-40ba-a856-5a102dc6cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.972765 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d6be0-05fd-40ba-a856-5a102dc6cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.973226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d6be0-05fd-40ba-a856-5a102dc6cbc8 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.974802 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d6be0-05fd-40ba-a856-5a102dc6cbc8 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.976635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d6be0-05fd-40ba-a856-5a102dc6cbc8 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.978907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 160/317] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:49.985171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa1cd9-4dd3-4231-b485-cf93747e2730 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.988978 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:50.082770 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801d068-5fdd-4955-8901-dd73ed59c6d6 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.083094 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801d068-5fdd-4955-8901-dd73ed59c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.083321 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801d068-5fdd-4955-8901-dd73ed59c6d6 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.085428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 161/318] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:50.091284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa1cd9-4dd3-4231-b485-cf93747e2730 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:50.092070 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771afb48-6c10-4dcc-bdcd-84a746556af8 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.092357 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771afb48-6c10-4dcc-bdcd-84a746556af8 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.092628 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771afb48-6c10-4dcc-bdcd-84a746556af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.111236 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-771afb48-6c10-4dcc-bdcd-84a746556af8 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:50.112565 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-771afb48-6c10-4dcc-bdcd-84a746556af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:50.134871 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94c36d-0c52-43de-b2c6-f6256e5be9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:50.135484 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94c36d-0c52-43de-b2c6-f6256e5be9be None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.135749 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94c36d-0c52-43de-b2c6-f6256e5be9be None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.136013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94c36d-0c52-43de-b2c6-f6256e5be9be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.137303 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94c36d-0c52-43de-b2c6-f6256e5be9be None admin] RBAC: Adding query filter params (role.id=8fb869cab8f84a7181324bcafe554ba6, scope.project.id=f8531c2d09da496ab76402401d9fc34b, user.id=2907582dad68489699b2f563f2090ff2) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:50.137606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94c36d-0c52-43de-b2c6-f6256e5be9be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:50.139589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94c36d-0c52-43de-b2c6-f6256e5be9be None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:50.148935 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 158/319] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/role_assignments?user.id=2907582dad68489699b2f563f2090ff2&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=8fb869cab8f84a7181324bcafe554ba6 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:50.189546 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 162/320] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:50.464153 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94c36d-0c52-43de-b2c6-f6256e5be9be None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:50.539468 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:50.576844 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94c36d-0c52-43de-b2c6-f6256e5be9be None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:50.594395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc8401-b8f9-4c75-bb2d-964454897041 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.594721 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc8401-b8f9-4c75-bb2d-964454897041 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.594912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc8401-b8f9-4c75-bb2d-964454897041 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.600239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 163/321] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:50.601453 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928e6ff-a686-44c9-8556-50a65c0782b8 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.601731 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928e6ff-a686-44c9-8556-50a65c0782b8 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.602003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928e6ff-a686-44c9-8556-50a65c0782b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.615530 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaca31-796c-4858-8d73-0f0467cbf89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:50.616209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaca31-796c-4858-8d73-0f0467cbf89a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.616471 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaca31-796c-4858-8d73-0f0467cbf89a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.616727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaca31-796c-4858-8d73-0f0467cbf89a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.617848 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaca31-796c-4858-8d73-0f0467cbf89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:50.619280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaca31-796c-4858-8d73-0f0467cbf89a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:50.620879 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 159/322] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:50.621437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-d928e6ff-a686-44c9-8556-50a65c0782b8 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:50.622876 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-d928e6ff-a686-44c9-8556-50a65c0782b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:50.626384 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaca31-796c-4858-8d73-0f0467cbf89a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:50.700817 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 164/323] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:50.732498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaca31-796c-4858-8d73-0f0467cbf89a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:50.766217 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f07231-3a2b-43f3-bc86-b48022d38178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:50.766828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07231-3a2b-43f3-bc86-b48022d38178 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.767102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07231-3a2b-43f3-bc86-b48022d38178 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.767368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07231-3a2b-43f3-bc86-b48022d38178 None admin] PATH_INFO: `/v3/groups` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.767994 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f07231-3a2b-43f3-bc86-b48022d38178 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:50.769471 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f07231-3a2b-43f3-bc86-b48022d38178 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:50.778552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:50.790284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 160/324] 10.222.0.43 () {60 vars in 1134 bytes} [Sun Oct 9 00:42:50 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:42:50.973645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928e6ff-a686-44c9-8556-50a65c0782b8 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:51.032649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:51.081014 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928e6ff-a686-44c9-8556-50a65c0782b8 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:51.116255 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e89a7-bc3f-4050-9cc0-be68390943e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:51.117817 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e89a7-bc3f-4050-9cc0-be68390943e1 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.117817 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e89a7-bc3f-4050-9cc0-be68390943e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.117817 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e89a7-bc3f-4050-9cc0-be68390943e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.128377 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e89a7-bc3f-4050-9cc0-be68390943e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:51.131384 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd65ba1-e649-49a4-b3df-1cf489e66d09 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.131660 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd65ba1-e649-49a4-b3df-1cf489e66d09 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.131928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd65ba1-e649-49a4-b3df-1cf489e66d09 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.133751 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 161/325] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-e12e89a7-bc3f-4050-9cc0-be68390943e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:51.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:51.134717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:51.135537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 165/326] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:51.140154 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d9878-ea82-40c6-8243-98811b9f6176 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.140154 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d9878-ea82-40c6-8243-98811b9f6176 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.140154 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d9878-ea82-40c6-8243-98811b9f6176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.140557 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e89a7-bc3f-4050-9cc0-be68390943e1 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:51.160660 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-e32d9878-ea82-40c6-8243-98811b9f6176 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:51.161900 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e32d9878-ea82-40c6-8243-98811b9f6176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:51.264209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 162/327] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:51.267470 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e89a7-bc3f-4050-9cc0-be68390943e1 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:51.283302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:51.304944 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c651a-702f-4998-ba40-da85c45f318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:51.305570 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c651a-702f-4998-ba40-da85c45f318a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.305846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c651a-702f-4998-ba40-da85c45f318a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.306115 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c651a-702f-4998-ba40-da85c45f318a None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.306774 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c651a-702f-4998-ba40-da85c45f318a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:51.307070 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c651a-702f-4998-ba40-da85c45f318a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:51.309858 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c651a-702f-4998-ba40-da85c45f318a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:51.317828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 166/328] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:51.323974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d9878-ea82-40c6-8243-98811b9f6176 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:51.447545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d9878-ea82-40c6-8243-98811b9f6176 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:51.475133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:51.485788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f08363-c8f1-4954-867b-7372679772f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:51.486427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f08363-c8f1-4954-867b-7372679772f2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.486694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f08363-c8f1-4954-867b-7372679772f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.486955 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f08363-c8f1-4954-867b-7372679772f2 None admin] PATH_INFO: `/v3/users/a208072657384fac93a18ab1a6a6661d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.488100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f08363-c8f1-4954-867b-7372679772f2 None admin] RBAC: Authorizing `identity:get_user(user_id=a208072657384fac93a18ab1a6a6661d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:51.489567 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f08363-c8f1-4954-867b-7372679772f2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:51.491875 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 163/329] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:51 2022] GET /identity/v3/users/a208072657384fac93a18ab1a6a6661d => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:51.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c651a-702f-4998-ba40-da85c45f318a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:51.573669 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f08363-c8f1-4954-867b-7372679772f2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:51.625928 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c651a-702f-4998-ba40-da85c45f318a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:51.668523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839caa9-0911-44c4-9976-e96a4edbcac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:51.669832 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839caa9-0911-44c4-9976-e96a4edbcac1 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.670427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839caa9-0911-44c4-9976-e96a4edbcac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.670944 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839caa9-0911-44c4-9976-e96a4edbcac1 None admin] PATH_INFO: `/v3/system/users/a208072657384fac93a18ab1a6a6661d/roles/8fb869cab8f84a7181324bcafe554ba6` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.672626 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839caa9-0911-44c4-9976-e96a4edbcac1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a208072657384fac93a18ab1a6a6661d, role_id=8fb869cab8f84a7181324bcafe554ba6)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:51.679122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839caa9-0911-44c4-9976-e96a4edbcac1 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:51.691536 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 167/330] 10.222.0.43 () {58 vars in 1334 bytes} [Sun Oct 9 00:42:51 2022] PUT /identity/v3/system/users/a208072657384fac93a18ab1a6a6661d/roles/8fb869cab8f84a7181324bcafe554ba6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:51.703685 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f08363-c8f1-4954-867b-7372679772f2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:51.751586 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f4d33-c58d-44fe-a85f-66c01b16b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:51.752274 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f4d33-c58d-44fe-a85f-66c01b16b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.752548 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f4d33-c58d-44fe-a85f-66c01b16b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.752811 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f4d33-c58d-44fe-a85f-66c01b16b0d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.767140 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f4d33-c58d-44fe-a85f-66c01b16b0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-5a2f4d33-c58d-44fe-a85f-66c01b16b0d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:51.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:51.774141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:51.774987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:51.776170 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 164/331] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:51.781172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839caa9-0911-44c4-9976-e96a4edbcac1 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:51.849868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:51.935761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839caa9-0911-44c4-9976-e96a4edbcac1 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:51.971914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda7707-cb99-4fea-bb84-a44f02e13725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:51.972582 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7707-cb99-4fea-bb84-a44f02e13725 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.972857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7707-cb99-4fea-bb84-a44f02e13725 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.973126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7707-cb99-4fea-bb84-a44f02e13725 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.973790 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda7707-cb99-4fea-bb84-a44f02e13725 None admin] RBAC: Adding query filter params (name=member) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:51.974360 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda7707-cb99-4fea-bb84-a44f02e13725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:51.975530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda7707-cb99-4fea-bb84-a44f02e13725 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:51.984816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 168/332] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:51.990628 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f4d33-c58d-44fe-a85f-66c01b16b0d3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:52.051086 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:52.101799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f4d33-c58d-44fe-a85f-66c01b16b0d3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:52.145860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d56dd6-22d7-4ae5-a8ba-04aa7bf87eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:52.146662 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d56dd6-22d7-4ae5-a8ba-04aa7bf87eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:52.146943 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d56dd6-22d7-4ae5-a8ba-04aa7bf87eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:52.147218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d56dd6-22d7-4ae5-a8ba-04aa7bf87eb4 None admin] PATH_INFO: `/v3/users/02c42b66bfc14e408cf921a6070d7722` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:52.148404 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d56dd6-22d7-4ae5-a8ba-04aa7bf87eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=02c42b66bfc14e408cf921a6070d7722)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:52.149870 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d56dd6-22d7-4ae5-a8ba-04aa7bf87eb4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:52.151477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 165/333] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:51 2022] GET /identity/v3/users/02c42b66bfc14e408cf921a6070d7722 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:52.157429 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda7707-cb99-4fea-bb84-a44f02e13725 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:52.266507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:52.270128 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda7707-cb99-4fea-bb84-a44f02e13725 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:52.305035 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d67bde-0352-4e34-982a-60954d634252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:52.305650 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d67bde-0352-4e34-982a-60954d634252 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:52.305924 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d67bde-0352-4e34-982a-60954d634252 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:52.306246 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d67bde-0352-4e34-982a-60954d634252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:52.306961 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d67bde-0352-4e34-982a-60954d634252 None admin] RBAC: Adding query filter params (role.id=fa4a34a109e44660bbce4320a4c9a366, user.id=02c42b66bfc14e408cf921a6070d7722, scope.system=all) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:52.307312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d67bde-0352-4e34-982a-60954d634252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:52.308767 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d67bde-0352-4e34-982a-60954d634252 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:52.322381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 169/334] 10.222.0.43 () {56 vars in 1308 bytes} [Sun Oct 9 00:42:52 2022] GET /identity/v3/role_assignments?user.id=02c42b66bfc14e408cf921a6070d7722&scope.system=all&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:53.404402 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770d08f-a597-4c4e-9ef9-0f4deed584fa None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.404958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770d08f-a597-4c4e-9ef9-0f4deed584fa None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.404958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770d08f-a597-4c4e-9ef9-0f4deed584fa None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.406506 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 166/335] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:53.412220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b18b9-6c9f-48fd-8b55-49e449ba3c91 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.412657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b18b9-6c9f-48fd-8b55-49e449ba3c91 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.412756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b18b9-6c9f-48fd-8b55-49e449ba3c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.431497 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-545b18b9-6c9f-48fd-8b55-49e449ba3c91 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:53.432720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-545b18b9-6c9f-48fd-8b55-49e449ba3c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:53.503531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 170/336] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:53.816494 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770d08f-a597-4c4e-9ef9-0f4deed584fa None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:53.946263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770d08f-a597-4c4e-9ef9-0f4deed584fa None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:53.970659 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:53.983280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11650ce-ff27-430a-9eaa-b6b0cf9cfe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:53.983976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11650ce-ff27-430a-9eaa-b6b0cf9cfe01 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.984273 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11650ce-ff27-430a-9eaa-b6b0cf9cfe01 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.984538 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11650ce-ff27-430a-9eaa-b6b0cf9cfe01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.998679 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11650ce-ff27-430a-9eaa-b6b0cf9cfe01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-d11650ce-ff27-430a-9eaa-b6b0cf9cfe01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:54.003922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:54.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:54.005881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 167/337] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:54.013521 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b18b9-6c9f-48fd-8b55-49e449ba3c91 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:54.111501 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:54.124967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b18b9-6c9f-48fd-8b55-49e449ba3c91 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:54.167741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d3f1a-cc8f-416a-9e64-ab4146a32baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:54.168377 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d3f1a-cc8f-416a-9e64-ab4146a32baf None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.168647 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d3f1a-cc8f-416a-9e64-ab4146a32baf None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.168911 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d3f1a-cc8f-416a-9e64-ab4146a32baf None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.169568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d3f1a-cc8f-416a-9e64-ab4146a32baf None admin] RBAC: Adding query filter params (name=member) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:54.169862 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d3f1a-cc8f-416a-9e64-ab4146a32baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:54.171212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d3f1a-cc8f-416a-9e64-ab4146a32baf None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:54.179671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 171/338] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:54.185730 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11650ce-ff27-430a-9eaa-b6b0cf9cfe01 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:54.198836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e5d4a-3578-482e-a6bd-ec95ac7115a8 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.199380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e5d4a-3578-482e-a6bd-ec95ac7115a8 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.199817 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e5d4a-3578-482e-a6bd-ec95ac7115a8 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.201359 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 172/339] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:54.213939 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea05785-709c-4ebf-b8b8-f5422660456d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.214484 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea05785-709c-4ebf-b8b8-f5422660456d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.214756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea05785-709c-4ebf-b8b8-f5422660456d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.241652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-bea05785-709c-4ebf-b8b8-f5422660456d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:54.242823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-bea05785-709c-4ebf-b8b8-f5422660456d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:54.307882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11650ce-ff27-430a-9eaa-b6b0cf9cfe01 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:54.361457 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a887d1-3e41-46bf-bb2b-6b8f9f4c2f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:54.362619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a887d1-3e41-46bf-bb2b-6b8f9f4c2f0d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.363071 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a887d1-3e41-46bf-bb2b-6b8f9f4c2f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.363522 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a887d1-3e41-46bf-bb2b-6b8f9f4c2f0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.395055 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 173/340] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:54.458961 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:54.479660 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a887d1-3e41-46bf-bb2b-6b8f9f4c2f0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:54.485252 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a887d1-3e41-46bf-bb2b-6b8f9f4c2f0d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:54.607566 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 168/341] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:54.617566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea05785-709c-4ebf-b8b8-f5422660456d None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:54.733643 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:54.757712 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea05785-709c-4ebf-b8b8-f5422660456d None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:54.809874 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be929-2cb9-4733-81c7-d72e5f7646a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:54.810786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be929-2cb9-4733-81c7-d72e5f7646a7 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.811113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be929-2cb9-4733-81c7-d72e5f7646a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.811383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be929-2cb9-4733-81c7-d72e5f7646a7 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.812719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2be929-2cb9-4733-81c7-d72e5f7646a7 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:54.814232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2be929-2cb9-4733-81c7-d72e5f7646a7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:54.816579 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 174/342] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:54 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:54.822558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a887d1-3e41-46bf-bb2b-6b8f9f4c2f0d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:54.898215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be929-2cb9-4733-81c7-d72e5f7646a7 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:54.985375 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:55.009535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a887d1-3e41-46bf-bb2b-6b8f9f4c2f0d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.055505 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a0c66-94dc-4d0c-99f4-f4d903ff41f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.056480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a0c66-94dc-4d0c-99f4-f4d903ff41f2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.056898 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a0c66-94dc-4d0c-99f4-f4d903ff41f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.057309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a0c66-94dc-4d0c-99f4-f4d903ff41f2 None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.067246 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a0c66-94dc-4d0c-99f4-f4d903ff41f2 None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:55.069702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a0c66-94dc-4d0c-99f4-f4d903ff41f2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:55.072736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 169/343] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:54 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:55.074871 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00be19-471e-461c-871e-ab74710fb856 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.075298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00be19-471e-461c-871e-ab74710fb856 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.075709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00be19-471e-461c-871e-ab74710fb856 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.078131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 170/344] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:55.098669 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9deef-aef8-4cd2-86c2-ad97ff8e87e8 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.099467 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9deef-aef8-4cd2-86c2-ad97ff8e87e8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.099882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9deef-aef8-4cd2-86c2-ad97ff8e87e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.107225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be929-2cb9-4733-81c7-d72e5f7646a7 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-dfe9deef-aef8-4cd2-86c2-ad97ff8e87e8 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:55.125330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dfe9deef-aef8-4cd2-86c2-ad97ff8e87e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:55.189827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc4776-ca7d-4a1e-9275-43dcd3d0170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.190397 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc4776-ca7d-4a1e-9275-43dcd3d0170d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.190664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc4776-ca7d-4a1e-9275-43dcd3d0170d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.190922 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc4776-ca7d-4a1e-9275-43dcd3d0170d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.208349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc4776-ca7d-4a1e-9275-43dcd3d0170d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-8cfc4776-ca7d-4a1e-9275-43dcd3d0170d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:55.214147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:55.215114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:55.216003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:55.218690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 175/345] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:55.227083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc4776-ca7d-4a1e-9275-43dcd3d0170d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:55.244992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:55.260876 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 171/346] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:55.269254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9deef-aef8-4cd2-86c2-ad97ff8e87e8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:55.361393 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc4776-ca7d-4a1e-9275-43dcd3d0170d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.398812 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c1b44-a183-4849-ba0f-d8bf2d52f3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.399816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c1b44-a183-4849-ba0f-d8bf2d52f3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.400320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c1b44-a183-4849-ba0f-d8bf2d52f3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.400833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c1b44-a183-4849-ba0f-d8bf2d52f3f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.401741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c1b44-a183-4849-ba0f-d8bf2d52f3f7 None admin] RBAC: Adding query filter params (group.id=52f150a50df6488cb3bd50c79106dd1e, role.id=fa4a34a109e44660bbce4320a4c9a366, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:55.402235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c1b44-a183-4849-ba0f-d8bf2d52f3f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:55.403895 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c1b44-a183-4849-ba0f-d8bf2d52f3f7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:55.410316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 176/347] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/role_assignments?group.id=52f150a50df6488cb3bd50c79106dd1e&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:55.411916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e3ff-4542-4bbf-a57b-d2c91db80508 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.412420 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e3ff-4542-4bbf-a57b-d2c91db80508 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.413054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579e3ff-4542-4bbf-a57b-d2c91db80508 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.414499 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 177/348] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:55.420163 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21586d93-8e00-44b8-919b-99b7f2d96e1d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.420734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21586d93-8e00-44b8-919b-99b7f2d96e1d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.421235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21586d93-8e00-44b8-919b-99b7f2d96e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.438402 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:55.441893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-21586d93-8e00-44b8-919b-99b7f2d96e1d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:55.443419 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-21586d93-8e00-44b8-919b-99b7f2d96e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:55.492222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9deef-aef8-4cd2-86c2-ad97ff8e87e8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.517374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 178/349] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:55.568080 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38470cd0-3373-4133-ba58-c41c710378c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.568838 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38470cd0-3373-4133-ba58-c41c710378c2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.569111 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38470cd0-3373-4133-ba58-c41c710378c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.569376 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38470cd0-3373-4133-ba58-c41c710378c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.570054 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38470cd0-3373-4133-ba58-c41c710378c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:55.570351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38470cd0-3373-4133-ba58-c41c710378c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:55.571810 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38470cd0-3373-4133-ba58-c41c710378c2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:55.581348 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 172/350] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:55.587370 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21586d93-8e00-44b8-919b-99b7f2d96e1d None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:55.590326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:55.718312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21586d93-8e00-44b8-919b-99b7f2d96e1d None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.755590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe41d5-0d2c-4303-a3a7-f6414ffe795c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.756643 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe41d5-0d2c-4303-a3a7-f6414ffe795c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.757114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe41d5-0d2c-4303-a3a7-f6414ffe795c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.757913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe41d5-0d2c-4303-a3a7-f6414ffe795c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.830128 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe41d5-0d2c-4303-a3a7-f6414ffe795c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:55.831604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe41d5-0d2c-4303-a3a7-f6414ffe795c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:55.833605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:55.921142 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38470cd0-3373-4133-ba58-c41c710378c2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:55.938254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 179/351] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:55.943846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe41d5-0d2c-4303-a3a7-f6414ffe795c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.044794 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe41d5-0d2c-4303-a3a7-f6414ffe795c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.046226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.080776 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52678de9-d32f-4c16-9273-dd2718d5c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.081416 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678de9-d32f-4c16-9273-dd2718d5c53f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.081689 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678de9-d32f-4c16-9273-dd2718d5c53f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.081960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678de9-d32f-4c16-9273-dd2718d5c53f None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.083108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52678de9-d32f-4c16-9273-dd2718d5c53f None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.084620 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52678de9-d32f-4c16-9273-dd2718d5c53f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.086268 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 180/352] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:56.087210 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52678de9-d32f-4c16-9273-dd2718d5c53f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.122735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38470cd0-3373-4133-ba58-c41c710378c2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.171307 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9666b7a-8a77-4315-b892-28b98a7f0e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.171957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666b7a-8a77-4315-b892-28b98a7f0e1f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.172264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666b7a-8a77-4315-b892-28b98a7f0e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.172535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666b7a-8a77-4315-b892-28b98a7f0e1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.191399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.198793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9666b7a-8a77-4315-b892-28b98a7f0e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e9666b7a-8a77-4315-b892-28b98a7f0e1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:56.205381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:56.206323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:42:56.207179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 173/353] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:56.208505 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a794de-d210-4878-b39a-41257b331e8d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.208505 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a794de-d210-4878-b39a-41257b331e8d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.208505 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a794de-d210-4878-b39a-41257b331e8d None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.210423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 174/354] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:56.210975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a794de-d210-4878-b39a-41257b331e8d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.224804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52678de9-d32f-4c16-9273-dd2718d5c53f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.280532 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864b8a4-c760-45e2-95f9-3fcc9d9272e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.281173 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b8a4-c760-45e2-95f9-3fcc9d9272e4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.281439 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b8a4-c760-45e2-95f9-3fcc9d9272e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.281696 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b8a4-c760-45e2-95f9-3fcc9d9272e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.293268 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864b8a4-c760-45e2-95f9-3fcc9d9272e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-1864b8a4-c760-45e2-95f9-3fcc9d9272e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:56.298783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:56.299699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:56.300563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:56.305655 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 181/355] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:56.306625 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864b8a4-c760-45e2-95f9-3fcc9d9272e4 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.345254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.352322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a794de-d210-4878-b39a-41257b331e8d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.401664 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a70a2-5b10-4aec-b704-f148d2fbe626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.402295 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a70a2-5b10-4aec-b704-f148d2fbe626 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.402564 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a70a2-5b10-4aec-b704-f148d2fbe626 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.402832 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a70a2-5b10-4aec-b704-f148d2fbe626 None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.405874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a70a2-5b10-4aec-b704-f148d2fbe626 None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.407443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a70a2-5b10-4aec-b704-f148d2fbe626 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.409557 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 175/356] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:56.410703 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3d57-eef9-4f03-98b2-c2340562e69d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.411126 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3d57-eef9-4f03-98b2-c2340562e69d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.411393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3d57-eef9-4f03-98b2-c2340562e69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.436195 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864b8a4-c760-45e2-95f9-3fcc9d9272e4 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.437396 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-529c3d57-eef9-4f03-98b2-c2340562e69d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:56.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-529c3d57-eef9-4f03-98b2-c2340562e69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:56.479162 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d2ad1-3bf2-4f08-9de3-0b100a56c4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.479786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d2ad1-3bf2-4f08-9de3-0b100a56c4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.480070 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d2ad1-3bf2-4f08-9de3-0b100a56c4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.480375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d2ad1-3bf2-4f08-9de3-0b100a56c4b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.481046 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d2ad1-3bf2-4f08-9de3-0b100a56c4b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:56.481343 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d2ad1-3bf2-4f08-9de3-0b100a56c4b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.482832 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d2ad1-3bf2-4f08-9de3-0b100a56c4b9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.494167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 182/357] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:56.495018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d2ad1-3bf2-4f08-9de3-0b100a56c4b9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.519778 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.530655 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 176/358] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:56.532174 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3d57-eef9-4f03-98b2-c2340562e69d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.626147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.643041 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d2ad1-3bf2-4f08-9de3-0b100a56c4b9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.667638 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3d57-eef9-4f03-98b2-c2340562e69d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.686110 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c3847-c801-4fc6-90bf-06df290a27e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.687295 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c3847-c801-4fc6-90bf-06df290a27e5 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.688098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c3847-c801-4fc6-90bf-06df290a27e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.688542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c3847-c801-4fc6-90bf-06df290a27e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.689397 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c3847-c801-4fc6-90bf-06df290a27e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:56.689870 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c3847-c801-4fc6-90bf-06df290a27e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.692128 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c3847-c801-4fc6-90bf-06df290a27e5 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.705905 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 183/359] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:56.707079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c3847-c801-4fc6-90bf-06df290a27e5 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.709013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4769b8-5a75-4be0-a2f0-4d650860f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.710113 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4769b8-5a75-4be0-a2f0-4d650860f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.710544 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4769b8-5a75-4be0-a2f0-4d650860f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4769b8-5a75-4be0-a2f0-4d650860f5a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.711675 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4769b8-5a75-4be0-a2f0-4d650860f5a0 None admin] RBAC: Adding query filter params (group.id=52f150a50df6488cb3bd50c79106dd1e, role.id=d796a9636e044b848ecdc0f80ee9443d, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:56.712080 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4769b8-5a75-4be0-a2f0-4d650860f5a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.714175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4769b8-5a75-4be0-a2f0-4d650860f5a0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.720137 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 177/360] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/role_assignments?group.id=52f150a50df6488cb3bd50c79106dd1e&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=d796a9636e044b848ecdc0f80ee9443d => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:56.721425 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8796e-b7b9-4a3d-a0e3-29fae0b42c61 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.721706 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8796e-b7b9-4a3d-a0e3-29fae0b42c61 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.721974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8796e-b7b9-4a3d-a0e3-29fae0b42c61 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.723527 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 178/361] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:56.724159 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8796e-b7b9-4a3d-a0e3-29fae0b42c61 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.800352 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.847626 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c3847-c801-4fc6-90bf-06df290a27e5 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.848224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8796e-b7b9-4a3d-a0e3-29fae0b42c61 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.886185 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04167d74-44a3-409a-b4a9-51601bf212dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.886727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167d74-44a3-409a-b4a9-51601bf212dd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.887000 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167d74-44a3-409a-b4a9-51601bf212dd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.887272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167d74-44a3-409a-b4a9-51601bf212dd None admin] PATH_INFO: `/v3/users/a208072657384fac93a18ab1a6a6661d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.888719 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04167d74-44a3-409a-b4a9-51601bf212dd None admin] RBAC: Authorizing `identity:get_user(user_id=a208072657384fac93a18ab1a6a6661d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.890309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04167d74-44a3-409a-b4a9-51601bf212dd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.890796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d580b2-4578-4dbd-a9be-d31748df6fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.891610 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d580b2-4578-4dbd-a9be-d31748df6fce None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.892107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d580b2-4578-4dbd-a9be-d31748df6fce None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.896343 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 179/362] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/users/a208072657384fac93a18ab1a6a6661d => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:56.896343 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f8f1-c537-4d85-b8b2-3d13ab94d5fd None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.896343 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f8f1-c537-4d85-b8b2-3d13ab94d5fd None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.896343 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f8f1-c537-4d85-b8b2-3d13ab94d5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.897068 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d580b2-4578-4dbd-a9be-d31748df6fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.914461 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bb92f8f1-c537-4d85-b8b2-3d13ab94d5fd None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:56.915681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bb92f8f1-c537-4d85-b8b2-3d13ab94d5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:56.927402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.977309 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d580b2-4578-4dbd-a9be-d31748df6fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.979223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d580b2-4578-4dbd-a9be-d31748df6fce None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.993727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 180/363] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:56.994590 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f8f1-c537-4d85-b8b2-3d13ab94d5fd None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.090569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 184/364] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:57.091874 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d580b2-4578-4dbd-a9be-d31748df6fce None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.098620 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.176543 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.213424 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f8f1-c537-4d85-b8b2-3d13ab94d5fd None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.228078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d580b2-4578-4dbd-a9be-d31748df6fce None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.285503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a1dc8-d4e7-4834-88c0-4f44fd0d63d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.286108 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a1dc8-d4e7-4834-88c0-4f44fd0d63d2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.286379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a1dc8-d4e7-4834-88c0-4f44fd0d63d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.286639 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a1dc8-d4e7-4834-88c0-4f44fd0d63d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.287539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a1dc8-d4e7-4834-88c0-4f44fd0d63d2 None admin] RBAC: Adding query filter params (role.id=8fb869cab8f84a7181324bcafe554ba6, user.id=a208072657384fac93a18ab1a6a6661d, scope.system=all) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:57.287883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a1dc8-d4e7-4834-88c0-4f44fd0d63d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.289307 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a1dc8-d4e7-4834-88c0-4f44fd0d63d2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.295931 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c33a9-1397-4330-b60d-e5534454c85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.296600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c33a9-1397-4330-b60d-e5534454c85a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.296866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c33a9-1397-4330-b60d-e5534454c85a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.297130 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c33a9-1397-4330-b60d-e5534454c85a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.320156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c33a9-1397-4330-b60d-e5534454c85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:57.321756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 181/365] 10.222.0.43 () {56 vars in 1308 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/role_assignments?user.id=a208072657384fac93a18ab1a6a6661d&scope.system=all&role.id=8fb869cab8f84a7181324bcafe554ba6 => generated 510 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:57.322762 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a1dc8-d4e7-4834-88c0-4f44fd0d63d2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-8d4c33a9-1397-4330-b60d-e5534454c85a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:57.329846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:57.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:57.331645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:57.332340 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 185/366] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:57.338611 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c33a9-1397-4330-b60d-e5534454c85a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.451557 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c33a9-1397-4330-b60d-e5534454c85a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.474306 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.489719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8b8ed-395b-4f21-a0c8-9d489efb4b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.490370 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8b8ed-395b-4f21-a0c8-9d489efb4b86 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.490642 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8b8ed-395b-4f21-a0c8-9d489efb4b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.490909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8b8ed-395b-4f21-a0c8-9d489efb4b86 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.491586 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8b8ed-395b-4f21-a0c8-9d489efb4b86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:57.491878 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8b8ed-395b-4f21-a0c8-9d489efb4b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.493296 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8b8ed-395b-4f21-a0c8-9d489efb4b86 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.502908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 186/367] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:57.503898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8b8ed-395b-4f21-a0c8-9d489efb4b86 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.612276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8b8ed-395b-4f21-a0c8-9d489efb4b86 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.615061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a1dc8-d4e7-4834-88c0-4f44fd0d63d2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.646992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.662274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfb3b1-b1b2-4df7-baa7-a756633ec9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.663455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb3b1-b1b2-4df7-baa7-a756633ec9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.664108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb3b1-b1b2-4df7-baa7-a756633ec9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.667217 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb3b1-b1b2-4df7-baa7-a756633ec9d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.673289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8193a1-57dd-4a72-9d69-e88bb017dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.674068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8193a1-57dd-4a72-9d69-e88bb017dc82 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.674342 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8193a1-57dd-4a72-9d69-e88bb017dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.674606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8193a1-57dd-4a72-9d69-e88bb017dc82 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.675730 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8193a1-57dd-4a72-9d69-e88bb017dc82 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.677832 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8193a1-57dd-4a72-9d69-e88bb017dc82 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.680288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 182/368] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:57.681017 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfb3b1-b1b2-4df7-baa7-a756633ec9d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:57.681146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8193a1-57dd-4a72-9d69-e88bb017dc82 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-17dfb3b1-b1b2-4df7-baa7-a756633ec9d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:57.688305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:57.689399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:57.690290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:57.693501 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 187/369] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:57.695020 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfb3b1-b1b2-4df7-baa7-a756633ec9d8 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.749218 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.833982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8193a1-57dd-4a72-9d69-e88bb017dc82 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.854903 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfb3b1-b1b2-4df7-baa7-a756633ec9d8 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.886085 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb6774-b129-42bf-b1ce-0f1613c59af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.887312 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6774-b129-42bf-b1ce-0f1613c59af5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.888061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6774-b129-42bf-b1ce-0f1613c59af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.888930 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6774-b129-42bf-b1ce-0f1613c59af5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.897955 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a0bc2-ce9d-45e5-9935-d8b181cc039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.898604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a0bc2-ce9d-45e5-9935-d8b181cc039f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.898877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a0bc2-ce9d-45e5-9935-d8b181cc039f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.899146 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a0bc2-ce9d-45e5-9935-d8b181cc039f None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.901028 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a0bc2-ce9d-45e5-9935-d8b181cc039f None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.902539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a0bc2-ce9d-45e5-9935-d8b181cc039f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.904895 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 188/370] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:57.905836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a0bc2-ce9d-45e5-9935-d8b181cc039f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.961419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.978530 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb6774-b129-42bf-b1ce-0f1613c59af5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.979994 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb6774-b129-42bf-b1ce-0f1613c59af5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.034423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a0bc2-ce9d-45e5-9935-d8b181cc039f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.037838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.085887 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b570-625b-429d-8147-8f1c4572511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.086948 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b570-625b-429d-8147-8f1c4572511f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.087428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b570-625b-429d-8147-8f1c4572511f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.087905 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b570-625b-429d-8147-8f1c4572511f None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.088933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579b570-625b-429d-8147-8f1c4572511f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:58.089523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579b570-625b-429d-8147-8f1c4572511f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.091218 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579b570-625b-429d-8147-8f1c4572511f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.102181 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 189/371] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:58.103699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b570-625b-429d-8147-8f1c4572511f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.113097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 183/372] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:58.114048 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb6774-b129-42bf-b1ce-0f1613c59af5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.209382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.227791 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb6774-b129-42bf-b1ce-0f1613c59af5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.231110 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b570-625b-429d-8147-8f1c4572511f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.272624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ae88b-e307-4bb9-8f1d-9a09b8bca66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.273345 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ae88b-e307-4bb9-8f1d-9a09b8bca66e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.273736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ae88b-e307-4bb9-8f1d-9a09b8bca66e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.273986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ae88b-e307-4bb9-8f1d-9a09b8bca66e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.274759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ae88b-e307-4bb9-8f1d-9a09b8bca66e None admin] RBAC: Adding query filter params (group.id=52f150a50df6488cb3bd50c79106dd1e, role.id=fa4a34a109e44660bbce4320a4c9a366, scope.project.id=f8531c2d09da496ab76402401d9fc34b) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:58.275138 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ae88b-e307-4bb9-8f1d-9a09b8bca66e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.276793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ae88b-e307-4bb9-8f1d-9a09b8bca66e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.281542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35723f-ba24-4fbf-a2e0-3871e9d9b1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.282388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35723f-ba24-4fbf-a2e0-3871e9d9b1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.282845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35723f-ba24-4fbf-a2e0-3871e9d9b1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.283522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 190/373] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/role_assignments?group.id=52f150a50df6488cb3bd50c79106dd1e&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:58.283740 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35723f-ba24-4fbf-a2e0-3871e9d9b1f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.284494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ae88b-e307-4bb9-8f1d-9a09b8bca66e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.319924 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.369198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35723f-ba24-4fbf-a2e0-3871e9d9b1f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.372179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35723f-ba24-4fbf-a2e0-3871e9d9b1f4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.407942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ae88b-e307-4bb9-8f1d-9a09b8bca66e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.449288 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc5e6f-4828-47f7-9613-84abef9facdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.449943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5e6f-4828-47f7-9613-84abef9facdd None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.450215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5e6f-4828-47f7-9613-84abef9facdd None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.450485 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5e6f-4828-47f7-9613-84abef9facdd None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.454034 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc5e6f-4828-47f7-9613-84abef9facdd None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.455505 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc5e6f-4828-47f7-9613-84abef9facdd None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.457644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 191/374] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:58.458955 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a481f41-7242-4322-afc7-9391234286c1 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.459230 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a481f41-7242-4322-afc7-9391234286c1 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.459492 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a481f41-7242-4322-afc7-9391234286c1 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.460978 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 192/375] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:58.462980 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a481f41-7242-4322-afc7-9391234286c1 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.475082 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.496795 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 184/376] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:58.498416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0c6af-7edf-4680-9ec5-a57bd63a405f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.498899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0c6af-7edf-4680-9ec5-a57bd63a405f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.499443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0c6af-7edf-4680-9ec5-a57bd63a405f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.520806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-e5f0c6af-7edf-4680-9ec5-a57bd63a405f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:58.522385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e5f0c6af-7edf-4680-9ec5-a57bd63a405f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:58.588381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.597065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a481f41-7242-4322-afc7-9391234286c1 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.607968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 185/377] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:58.608916 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0c6af-7edf-4680-9ec5-a57bd63a405f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.649998 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935840c8-8e99-4485-b45a-1b1e310fca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.650671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935840c8-8e99-4485-b45a-1b1e310fca82 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.650946 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935840c8-8e99-4485-b45a-1b1e310fca82 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.651209 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935840c8-8e99-4485-b45a-1b1e310fca82 None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.652371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935840c8-8e99-4485-b45a-1b1e310fca82 None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.653879 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935840c8-8e99-4485-b45a-1b1e310fca82 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.655926 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 193/378] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:58.682358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935840c8-8e99-4485-b45a-1b1e310fca82 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.726099 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0c6af-7edf-4680-9ec5-a57bd63a405f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.740884 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.769510 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e23d5-8c80-43ae-8be4-e33078c5805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.770160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e23d5-8c80-43ae-8be4-e33078c5805c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.770440 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e23d5-8c80-43ae-8be4-e33078c5805c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.770714 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e23d5-8c80-43ae-8be4-e33078c5805c None admin] PATH_INFO: `/v3/projects/b4515502f4ca44c3b302803eb9e3faf6` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.772111 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e23d5-8c80-43ae-8be4-e33078c5805c None admin] RBAC: Authorizing `identity:get_project(project_id=b4515502f4ca44c3b302803eb9e3faf6)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.778913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e23d5-8c80-43ae-8be4-e33078c5805c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.780946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 186/379] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/projects/b4515502f4ca44c3b302803eb9e3faf6 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:58.788436 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e23d5-8c80-43ae-8be4-e33078c5805c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.826968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935840c8-8e99-4485-b45a-1b1e310fca82 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.863681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248d434-83c1-43e6-8eac-b96eab09ef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.864319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248d434-83c1-43e6-8eac-b96eab09ef30 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.864577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248d434-83c1-43e6-8eac-b96eab09ef30 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.864868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248d434-83c1-43e6-8eac-b96eab09ef30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.866077 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248d434-83c1-43e6-8eac-b96eab09ef30 None admin] RBAC: Adding query filter params (group.id=52f150a50df6488cb3bd50c79106dd1e, role.id=d796a9636e044b848ecdc0f80ee9443d, scope.project.id=f8531c2d09da496ab76402401d9fc34b) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:58.866374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248d434-83c1-43e6-8eac-b96eab09ef30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.867812 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248d434-83c1-43e6-8eac-b96eab09ef30 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.873820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 194/380] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/role_assignments?group.id=52f150a50df6488cb3bd50c79106dd1e&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=d796a9636e044b848ecdc0f80ee9443d => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:58.933625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e23d5-8c80-43ae-8be4-e33078c5805c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.936309 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248d434-83c1-43e6-8eac-b96eab09ef30 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.973749 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:59.042129 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274d67-ea32-4220-b8be-dddef3135347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:59.042129 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274d67-ea32-4220-b8be-dddef3135347 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.042129 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274d67-ea32-4220-b8be-dddef3135347 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.042129 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274d67-ea32-4220-b8be-dddef3135347 None admin] PATH_INFO: `/v3/groups/a9421988ba5d442a985a1700a3e07722` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.056134 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248d434-83c1-43e6-8eac-b96eab09ef30 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:59.069052 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274d67-ea32-4220-b8be-dddef3135347 None admin] RBAC: Authorizing `identity:get_group(group_id=a9421988ba5d442a985a1700a3e07722)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:59.070575 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274d67-ea32-4220-b8be-dddef3135347 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:59.072676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 187/381] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/groups/a9421988ba5d442a985a1700a3e07722 => generated 229 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:59.078625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274d67-ea32-4220-b8be-dddef3135347 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:59.094234 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f2a8a-2774-4f2c-a429-ebfc4fe24ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:59.095185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f2a8a-2774-4f2c-a429-ebfc4fe24ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.095616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f2a8a-2774-4f2c-a429-ebfc4fe24ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.096031 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f2a8a-2774-4f2c-a429-ebfc4fe24ec6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.109358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f2a8a-2774-4f2c-a429-ebfc4fe24ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-ef5f2a8a-2774-4f2c-a429-ebfc4fe24ec6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:59.115973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:59.116942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:59.117930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:42:59.120154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 195/382] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:59.131379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f2a8a-2774-4f2c-a429-ebfc4fe24ec6 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:59.178427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:59.277539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274d67-ea32-4220-b8be-dddef3135347 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:59.309128 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:59.323916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f2a8a-2774-4f2c-a429-ebfc4fe24ec6 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:59.344166 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc47a-728f-4129-82af-9852c2b18aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:59.344955 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc47a-728f-4129-82af-9852c2b18aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.345231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc47a-728f-4129-82af-9852c2b18aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.345499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfc47a-728f-4129-82af-9852c2b18aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.346222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfc47a-728f-4129-82af-9852c2b18aa0 None admin] RBAC: Adding query filter params (group.id=a9421988ba5d442a985a1700a3e07722, role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=b4515502f4ca44c3b302803eb9e3faf6) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:59.346523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfc47a-728f-4129-82af-9852c2b18aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:59.348593 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfc47a-728f-4129-82af-9852c2b18aa0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:59.355926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 188/383] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:59 2022] GET /identity/v3/role_assignments?group.id=a9421988ba5d442a985a1700a3e07722&scope.project.id=b4515502f4ca44c3b302803eb9e3faf6&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:59.376592 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94155c-b15d-437a-b5ab-618770ad03f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:59.377137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94155c-b15d-437a-b5ab-618770ad03f6 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.377473 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94155c-b15d-437a-b5ab-618770ad03f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.377744 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94155c-b15d-437a-b5ab-618770ad03f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.378415 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94155c-b15d-437a-b5ab-618770ad03f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:59.378713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94155c-b15d-437a-b5ab-618770ad03f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:59.380232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94155c-b15d-437a-b5ab-618770ad03f6 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:59.392055 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 196/384] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:59.397758 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc47a-728f-4129-82af-9852c2b18aa0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:59.531407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfc47a-728f-4129-82af-9852c2b18aa0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:59.543819 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:59.570631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27767661-c7b9-4e22-ad08-b02247ea0115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:59.571633 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767661-c7b9-4e22-ad08-b02247ea0115 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.572137 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767661-c7b9-4e22-ad08-b02247ea0115 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.572598 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767661-c7b9-4e22-ad08-b02247ea0115 None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.573994 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27767661-c7b9-4e22-ad08-b02247ea0115 None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:59.575666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27767661-c7b9-4e22-ad08-b02247ea0115 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:59.577893 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 189/385] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:59 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:59.583224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94155c-b15d-437a-b5ab-618770ad03f6 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:59.628762 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eabdb5-b377-4dc8-b02e-e929c15e9a76 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.628952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eabdb5-b377-4dc8-b02e-e929c15e9a76 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.629218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eabdb5-b377-4dc8-b02e-e929c15e9a76 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.631223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 190/386] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:59.639321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb35f04-8fa3-41a9-8e81-a7786edce157 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.639629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb35f04-8fa3-41a9-8e81-a7786edce157 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.639862 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb35f04-8fa3-41a9-8e81-a7786edce157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.677420 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-fcb35f04-8fa3-41a9-8e81-a7786edce157 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:59.680289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fcb35f04-8fa3-41a9-8e81-a7786edce157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:59.737371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94155c-b15d-437a-b5ab-618770ad03f6 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:59.779666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 191/387] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:59.790209 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e1d69-9c54-4f42-b800-02003844c2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:59.790866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e1d69-9c54-4f42-b800-02003844c2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.791141 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e1d69-9c54-4f42-b800-02003844c2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.791409 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e1d69-9c54-4f42-b800-02003844c2d3 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.796733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e1d69-9c54-4f42-b800-02003844c2d3 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:59.798189 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e1d69-9c54-4f42-b800-02003844c2d3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:59.800062 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 197/388] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:59 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:59.806151 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb35f04-8fa3-41a9-8e81-a7786edce157 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:59.933237 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb35f04-8fa3-41a9-8e81-a7786edce157 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:59.946534 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:59.977683 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e238cf-d66f-419a-9d7b-2bceb3b76db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:59.978695 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e238cf-d66f-419a-9d7b-2bceb3b76db4 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.979162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e238cf-d66f-419a-9d7b-2bceb3b76db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.979640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e238cf-d66f-419a-9d7b-2bceb3b76db4 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/groups/52f150a50df6488cb3bd50c79106dd1e/roles/fa4a34a109e44660bbce4320a4c9a366` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.984342 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e238cf-d66f-419a-9d7b-2bceb3b76db4 None admin] RBAC: Authorizing `identity:create_grant(project_id=24d37c4bb9ee4e17addb93014168fbdf, group_id=52f150a50df6488cb3bd50c79106dd1e, role_id=fa4a34a109e44660bbce4320a4c9a366)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:59.986120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e238cf-d66f-419a-9d7b-2bceb3b76db4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:00.002004 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 192/389] 10.222.0.43 () {58 vars in 1442 bytes} [Sun Oct 9 00:42:59 2022] PUT /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/groups/52f150a50df6488cb3bd50c79106dd1e/roles/fa4a34a109e44660bbce4320a4c9a366 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:00.134899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e1d69-9c54-4f42-b800-02003844c2d3 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:00.161571 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:00.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e1d69-9c54-4f42-b800-02003844c2d3 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:00.315557 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc04c-1d00-4e65-8b37-1ad34c1379eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:00.316588 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc04c-1d00-4e65-8b37-1ad34c1379eb None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.317082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc04c-1d00-4e65-8b37-1ad34c1379eb None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.317557 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc04c-1d00-4e65-8b37-1ad34c1379eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.329276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bc04c-1d00-4e65-8b37-1ad34c1379eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-b59bc04c-1d00-4e65-8b37-1ad34c1379eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:00.335032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:00.335983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:43:00.336893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:00.339546 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 198/390] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:00.345352 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e238cf-d66f-419a-9d7b-2bceb3b76db4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:00.464106 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e238cf-d66f-419a-9d7b-2bceb3b76db4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:00.502289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69226de-61b1-48da-97f2-570f88d7444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:00.503004 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69226de-61b1-48da-97f2-570f88d7444a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.503278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69226de-61b1-48da-97f2-570f88d7444a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.503545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69226de-61b1-48da-97f2-570f88d7444a None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.504282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69226de-61b1-48da-97f2-570f88d7444a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:00.504587 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69226de-61b1-48da-97f2-570f88d7444a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:00.506251 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69226de-61b1-48da-97f2-570f88d7444a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:00.515832 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 193/391] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:00.521447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc04c-1d00-4e65-8b37-1ad34c1379eb None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:00.607233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:00.632580 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc04c-1d00-4e65-8b37-1ad34c1379eb None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:00.675527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98bcda-236b-4027-b63b-587d9b04de90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:00.676276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98bcda-236b-4027-b63b-587d9b04de90 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.676555 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98bcda-236b-4027-b63b-587d9b04de90 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.676825 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98bcda-236b-4027-b63b-587d9b04de90 None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.678406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98bcda-236b-4027-b63b-587d9b04de90 None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:00.679937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98bcda-236b-4027-b63b-587d9b04de90 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:00.681897 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 199/392] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:43:00 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:00.687594 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69226de-61b1-48da-97f2-570f88d7444a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:00.731403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:00.823867 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69226de-61b1-48da-97f2-570f88d7444a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:00.861601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bca3d2-fd5c-4897-8746-5a1a52d454d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:00.862237 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca3d2-fd5c-4897-8746-5a1a52d454d4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.862516 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca3d2-fd5c-4897-8746-5a1a52d454d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.862787 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca3d2-fd5c-4897-8746-5a1a52d454d4 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.863918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bca3d2-fd5c-4897-8746-5a1a52d454d4 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:00.865883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bca3d2-fd5c-4897-8746-5a1a52d454d4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:00.867650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 194/393] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:00 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:00.875585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98bcda-236b-4027-b63b-587d9b04de90 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:00.986793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98bcda-236b-4027-b63b-587d9b04de90 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:01.025129 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ac215-5473-435d-9f22-7ec9337e0436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:01.025801 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ac215-5473-435d-9f22-7ec9337e0436 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.026076 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ac215-5473-435d-9f22-7ec9337e0436 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.026349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ac215-5473-435d-9f22-7ec9337e0436 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/groups/52f150a50df6488cb3bd50c79106dd1e/roles/d796a9636e044b848ecdc0f80ee9443d` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.029029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ac215-5473-435d-9f22-7ec9337e0436 None admin] RBAC: Authorizing `identity:create_grant(project_id=24d37c4bb9ee4e17addb93014168fbdf, group_id=52f150a50df6488cb3bd50c79106dd1e, role_id=d796a9636e044b848ecdc0f80ee9443d)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:01.030472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ac215-5473-435d-9f22-7ec9337e0436 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:01.049955 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 200/394] 10.222.0.43 () {58 vars in 1442 bytes} [Sun Oct 9 00:43:00 2022] PUT /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf/groups/52f150a50df6488cb3bd50c79106dd1e/roles/d796a9636e044b848ecdc0f80ee9443d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:01.275861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4e9e6-e5ed-4f12-a8ec-67cbae337e35 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.276272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4e9e6-e5ed-4f12-a8ec-67cbae337e35 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.276475 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4e9e6-e5ed-4f12-a8ec-67cbae337e35 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.278043 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 195/395] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:01.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b492907-bac1-47b2-960b-9604872d8e15 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.284366 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b492907-bac1-47b2-960b-9604872d8e15 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.284450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b492907-bac1-47b2-960b-9604872d8e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.316741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-6b492907-bac1-47b2-960b-9604872d8e15 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:01.317919 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-6b492907-bac1-47b2-960b-9604872d8e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:01.320673 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:01.409530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 201/396] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:01.701796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4e9e6-e5ed-4f12-a8ec-67cbae337e35 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.799999 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c40cf-ed6a-432a-91b6-c324a3bc12f1 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.800330 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c40cf-ed6a-432a-91b6-c324a3bc12f1 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.800604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c40cf-ed6a-432a-91b6-c324a3bc12f1 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.802204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 202/397] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:01.807764 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b8aa1-1489-4986-8212-de6598121d97 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.808077 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b8aa1-1489-4986-8212-de6598121d97 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.808352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b8aa1-1489-4986-8212-de6598121d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.830827 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:01.837856 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-e38b8aa1-1489-4986-8212-de6598121d97 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:01.839053 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e38b8aa1-1489-4986-8212-de6598121d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:01.843878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4e9e6-e5ed-4f12-a8ec-67cbae337e35 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:01.911026 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494176dd-2967-4e4d-a68f-c73de7f21ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:01.911701 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494176dd-2967-4e4d-a68f-c73de7f21ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.912173 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494176dd-2967-4e4d-a68f-c73de7f21ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.912449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494176dd-2967-4e4d-a68f-c73de7f21ad6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.938402 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494176dd-2967-4e4d-a68f-c73de7f21ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-494176dd-2967-4e4d-a68f-c73de7f21ad6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:01.943828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:01.944857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:43:01.945716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:01.949459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 196/398] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:01.957202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494176dd-2967-4e4d-a68f-c73de7f21ad6 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.977101 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 203/399] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:43:02.123164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494176dd-2967-4e4d-a68f-c73de7f21ad6 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.163004 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d20a73-c8d4-4de0-ae96-5357d9995586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.163673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20a73-c8d4-4de0-ae96-5357d9995586 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.163950 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20a73-c8d4-4de0-ae96-5357d9995586 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.164283 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20a73-c8d4-4de0-ae96-5357d9995586 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.164944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d20a73-c8d4-4de0-ae96-5357d9995586 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:02.165239 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d20a73-c8d4-4de0-ae96-5357d9995586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:02.166619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d20a73-c8d4-4de0-ae96-5357d9995586 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:02.175806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 197/400] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:43:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:02.183313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b8aa1-1489-4986-8212-de6598121d97 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.204303 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8734dfd-9235-4b7c-a11f-d045b4ac7725 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.204608 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8734dfd-9235-4b7c-a11f-d045b4ac7725 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.204850 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8734dfd-9235-4b7c-a11f-d045b4ac7725 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.206198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 198/401] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:02.217623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d096d-a284-4b84-a906-b2c0f98d23f1 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.217907 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d096d-a284-4b84-a906-b2c0f98d23f1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.218179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d096d-a284-4b84-a906-b2c0f98d23f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.251924 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b31d096d-a284-4b84-a906-b2c0f98d23f1 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:02.253156 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b31d096d-a284-4b84-a906-b2c0f98d23f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:02.276292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:02.277131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:02.318413 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b8aa1-1489-4986-8212-de6598121d97 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.357328 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35051a2-7f65-4f52-a78f-ff4dc96eb3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.358002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35051a2-7f65-4f52-a78f-ff4dc96eb3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.358276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35051a2-7f65-4f52-a78f-ff4dc96eb3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.358545 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35051a2-7f65-4f52-a78f-ff4dc96eb3d7 None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.360022 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35051a2-7f65-4f52-a78f-ff4dc96eb3d7 None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:02.362033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35051a2-7f65-4f52-a78f-ff4dc96eb3d7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:02.364207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 204/402] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:02.369736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35051a2-7f65-4f52-a78f-ff4dc96eb3d7 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.383039 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 199/403] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:02.413513 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d096d-a284-4b84-a906-b2c0f98d23f1 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.479232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35051a2-7f65-4f52-a78f-ff4dc96eb3d7 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.523159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c6011-d33f-49f3-bfef-0e34334feb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.523905 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c6011-d33f-49f3-bfef-0e34334feb71 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.524374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c6011-d33f-49f3-bfef-0e34334feb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.524673 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c6011-d33f-49f3-bfef-0e34334feb71 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.525829 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c6011-d33f-49f3-bfef-0e34334feb71 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:02.527511 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c6011-d33f-49f3-bfef-0e34334feb71 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:02.529532 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 205/404] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:02.535395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c6011-d33f-49f3-bfef-0e34334feb71 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.557707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:02.603361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d096d-a284-4b84-a906-b2c0f98d23f1 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.651582 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c6011-d33f-49f3-bfef-0e34334feb71 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.689904 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723a124-07ea-46ce-a371-790eec691875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.690929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723a124-07ea-46ce-a371-790eec691875 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.691582 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723a124-07ea-46ce-a371-790eec691875 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.692068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723a124-07ea-46ce-a371-790eec691875 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.692760 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba880e8-32c1-4c19-8d34-7fa9cd4f5182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.693606 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba880e8-32c1-4c19-8d34-7fa9cd4f5182 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.694083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba880e8-32c1-4c19-8d34-7fa9cd4f5182 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.694375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba880e8-32c1-4c19-8d34-7fa9cd4f5182 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b/groups/52f150a50df6488cb3bd50c79106dd1e/roles/fa4a34a109e44660bbce4320a4c9a366` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.697093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba880e8-32c1-4c19-8d34-7fa9cd4f5182 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8531c2d09da496ab76402401d9fc34b, group_id=52f150a50df6488cb3bd50c79106dd1e, role_id=fa4a34a109e44660bbce4320a4c9a366)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:02.698540 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba880e8-32c1-4c19-8d34-7fa9cd4f5182 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:02.706161 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723a124-07ea-46ce-a371-790eec691875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b723a124-07ea-46ce-a371-790eec691875 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:02.712789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:02.713727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:43:02.715003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:02.715796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 206/405] 10.222.0.43 () {58 vars in 1442 bytes} [Sun Oct 9 00:43:02 2022] PUT /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b/groups/52f150a50df6488cb3bd50c79106dd1e/roles/fa4a34a109e44660bbce4320a4c9a366 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:43:02.715796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba880e8-32c1-4c19-8d34-7fa9cd4f5182 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.720215 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 200/406] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:02.724497 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723a124-07ea-46ce-a371-790eec691875 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.740168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:02.806872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:02.864533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723a124-07ea-46ce-a371-790eec691875 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.869468 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba880e8-32c1-4c19-8d34-7fa9cd4f5182 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.919280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c858f1d-4cda-413f-886e-1cf1a6063f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.920328 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c858f1d-4cda-413f-886e-1cf1a6063f89 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.922374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c858f1d-4cda-413f-886e-1cf1a6063f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.922868 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c858f1d-4cda-413f-886e-1cf1a6063f89 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.923752 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c858f1d-4cda-413f-886e-1cf1a6063f89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:02.925153 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c858f1d-4cda-413f-886e-1cf1a6063f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:02.926787 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c858f1d-4cda-413f-886e-1cf1a6063f89 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:02.935164 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf6de-0d27-4f79-bfc2-538594059e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.936198 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf6de-0d27-4f79-bfc2-538594059e98 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.936678 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf6de-0d27-4f79-bfc2-538594059e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.937147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf6de-0d27-4f79-bfc2-538594059e98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.948074 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 201/407] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:02.949251 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf6de-0d27-4f79-bfc2-538594059e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:02.951758 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c858f1d-4cda-413f-886e-1cf1a6063f89 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-358cf6de-0d27-4f79-bfc2-538594059e98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:02.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:02.955525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:02.956400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:02.958790 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 207/408] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:02.962707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf6de-0d27-4f79-bfc2-538594059e98 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.044009 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:03.078887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c858f1d-4cda-413f-886e-1cf1a6063f89 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.080423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf6de-0d27-4f79-bfc2-538594059e98 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.106674 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:03.119256 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59646238-ac58-4bdc-aa21-91df8f08d22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.120012 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59646238-ac58-4bdc-aa21-91df8f08d22c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.120470 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59646238-ac58-4bdc-aa21-91df8f08d22c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.120832 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59646238-ac58-4bdc-aa21-91df8f08d22c None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.121659 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59646238-ac58-4bdc-aa21-91df8f08d22c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:03.122056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59646238-ac58-4bdc-aa21-91df8f08d22c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.123522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59646238-ac58-4bdc-aa21-91df8f08d22c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.125268 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16121e-afc9-460c-8bf3-77fc205b5dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.126465 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16121e-afc9-460c-8bf3-77fc205b5dca None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.126895 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16121e-afc9-460c-8bf3-77fc205b5dca None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.127296 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16121e-afc9-460c-8bf3-77fc205b5dca None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.128585 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16121e-afc9-460c-8bf3-77fc205b5dca None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.130936 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16121e-afc9-460c-8bf3-77fc205b5dca None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.137952 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 208/410] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:03.138290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 202/410] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:03.139257 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59646238-ac58-4bdc-aa21-91df8f08d22c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.139974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16121e-afc9-460c-8bf3-77fc205b5dca None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.261160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16121e-afc9-460c-8bf3-77fc205b5dca None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.305581 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818f710-9516-4049-b281-8abdead4f6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.306472 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818f710-9516-4049-b281-8abdead4f6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.307128 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818f710-9516-4049-b281-8abdead4f6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.307547 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818f710-9516-4049-b281-8abdead4f6b9 None admin] PATH_INFO: `/v3/groups/a9421988ba5d442a985a1700a3e07722` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.309492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818f710-9516-4049-b281-8abdead4f6b9 None admin] RBAC: Authorizing `identity:get_group(group_id=a9421988ba5d442a985a1700a3e07722)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.311579 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818f710-9516-4049-b281-8abdead4f6b9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.318612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 203/411] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:43:03 2022] GET /identity/v3/groups/a9421988ba5d442a985a1700a3e07722 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:03.318612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca609f-e320-449f-8e3d-a6f1e56b2a3d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.318612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca609f-e320-449f-8e3d-a6f1e56b2a3d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.318612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca609f-e320-449f-8e3d-a6f1e56b2a3d None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.319637 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 204/412] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:03.320189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca609f-e320-449f-8e3d-a6f1e56b2a3d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.333550 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59646238-ac58-4bdc-aa21-91df8f08d22c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.337740 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:03.374786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb389b9f-fd52-4aa1-a9fd-cc8a5679e582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.375806 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb389b9f-fd52-4aa1-a9fd-cc8a5679e582 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.376551 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb389b9f-fd52-4aa1-a9fd-cc8a5679e582 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.377487 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb389b9f-fd52-4aa1-a9fd-cc8a5679e582 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.379038 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb389b9f-fd52-4aa1-a9fd-cc8a5679e582 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.380919 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb389b9f-fd52-4aa1-a9fd-cc8a5679e582 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.383279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 209/413] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:03 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:03.384881 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56c5a-8db5-46a6-89b6-eb2169dafdc1 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.385381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56c5a-8db5-46a6-89b6-eb2169dafdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.385851 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56c5a-8db5-46a6-89b6-eb2169dafdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.410040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-49b56c5a-8db5-46a6-89b6-eb2169dafdc1 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:03.412335 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-49b56c5a-8db5-46a6-89b6-eb2169dafdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:03.434905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca609f-e320-449f-8e3d-a6f1e56b2a3d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.473278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ab06c-c258-4621-bf1d-73382d3536be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.473904 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ab06c-c258-4621-bf1d-73382d3536be None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.474287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ab06c-c258-4621-bf1d-73382d3536be None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.474550 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ab06c-c258-4621-bf1d-73382d3536be None admin] PATH_INFO: `/v3/projects/b4515502f4ca44c3b302803eb9e3faf6` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.475252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:03.477379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ab06c-c258-4621-bf1d-73382d3536be None admin] RBAC: Authorizing `identity:get_project(project_id=b4515502f4ca44c3b302803eb9e3faf6)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.478900 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ab06c-c258-4621-bf1d-73382d3536be None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.481672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 205/414] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:03 2022] GET /identity/v3/projects/b4515502f4ca44c3b302803eb9e3faf6 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:03.486505 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ab06c-c258-4621-bf1d-73382d3536be None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.501558 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 210/415] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:03.502750 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b56c5a-8db5-46a6-89b6-eb2169dafdc1 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.634011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:03.661024 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ab06c-c258-4621-bf1d-73382d3536be None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.700093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f742df-b782-48c9-8b35-369ad7d64cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.701144 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f742df-b782-48c9-8b35-369ad7d64cc3 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.701427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f742df-b782-48c9-8b35-369ad7d64cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.701700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f742df-b782-48c9-8b35-369ad7d64cc3 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b/groups/52f150a50df6488cb3bd50c79106dd1e/roles/d796a9636e044b848ecdc0f80ee9443d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.703860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f742df-b782-48c9-8b35-369ad7d64cc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8531c2d09da496ab76402401d9fc34b, group_id=52f150a50df6488cb3bd50c79106dd1e, role_id=d796a9636e044b848ecdc0f80ee9443d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.705640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f742df-b782-48c9-8b35-369ad7d64cc3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.714374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b56c5a-8db5-46a6-89b6-eb2169dafdc1 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.721948 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 206/416] 10.222.0.43 () {58 vars in 1442 bytes} [Sun Oct 9 00:43:03 2022] PUT /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b/groups/52f150a50df6488cb3bd50c79106dd1e/roles/d796a9636e044b848ecdc0f80ee9443d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:03.796567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51963ad3-6fda-408b-89b6-7cad03e6063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.797420 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51963ad3-6fda-408b-89b6-7cad03e6063c None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.797515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51963ad3-6fda-408b-89b6-7cad03e6063c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.798617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51963ad3-6fda-408b-89b6-7cad03e6063c None admin] PATH_INFO: `/v3/projects/b4515502f4ca44c3b302803eb9e3faf6/groups/a9421988ba5d442a985a1700a3e07722/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.805701 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51963ad3-6fda-408b-89b6-7cad03e6063c None admin] RBAC: Authorizing `identity:create_grant(project_id=b4515502f4ca44c3b302803eb9e3faf6, group_id=a9421988ba5d442a985a1700a3e07722, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.807174 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51963ad3-6fda-408b-89b6-7cad03e6063c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.825447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 211/417] 10.222.0.43 () {58 vars in 1442 bytes} [Sun Oct 9 00:43:03 2022] PUT /identity/v3/projects/b4515502f4ca44c3b302803eb9e3faf6/groups/a9421988ba5d442a985a1700a3e07722/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:03.930655 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f742df-b782-48c9-8b35-369ad7d64cc3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.042743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f742df-b782-48c9-8b35-369ad7d64cc3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:04.078729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cb7c1-686f-4955-aaed-ef900773994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.079368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb7c1-686f-4955-aaed-ef900773994d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.079644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb7c1-686f-4955-aaed-ef900773994d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.079915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb7c1-686f-4955-aaed-ef900773994d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.082986 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:04.092921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cb7c1-686f-4955-aaed-ef900773994d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-eb7cb7c1-686f-4955-aaed-ef900773994d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:04.098324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:04.099285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:04.100555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 207/418] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:04.105774 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51963ad3-6fda-408b-89b6-7cad03e6063c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.156292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:04.221508 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51963ad3-6fda-408b-89b6-7cad03e6063c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:04.269714 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d577ed2-e245-409a-b36c-c20fcf923897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.270329 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d577ed2-e245-409a-b36c-c20fcf923897 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.270601 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d577ed2-e245-409a-b36c-c20fcf923897 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.270872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d577ed2-e245-409a-b36c-c20fcf923897 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.271635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d577ed2-e245-409a-b36c-c20fcf923897 None admin] RBAC: Adding query filter params (name=member) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:04.271934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d577ed2-e245-409a-b36c-c20fcf923897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:04.273326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d577ed2-e245-409a-b36c-c20fcf923897 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:04.284296 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 212/419] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:04.290203 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cb7c1-686f-4955-aaed-ef900773994d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.337574 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f679ef-65a7-42a5-8776-e1bcd13c4828 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.338093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f679ef-65a7-42a5-8776-e1bcd13c4828 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.338093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f679ef-65a7-42a5-8776-e1bcd13c4828 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.339673 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 213/420] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:04.344990 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a856d3-8a6b-444a-adf8-ee0869ea322a None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.345292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a856d3-8a6b-444a-adf8-ee0869ea322a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.345576 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a856d3-8a6b-444a-adf8-ee0869ea322a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.365266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-b1a856d3-8a6b-444a-adf8-ee0869ea322a None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:04.366749 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-b1a856d3-8a6b-444a-adf8-ee0869ea322a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:04.442382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cb7c1-686f-4955-aaed-ef900773994d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:04.471599 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 214/421] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:43:04.490008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615081a-5e18-401b-81e3-80d4153cea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.490734 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615081a-5e18-401b-81e3-80d4153cea1d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.491007 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615081a-5e18-401b-81e3-80d4153cea1d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.491277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615081a-5e18-401b-81e3-80d4153cea1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.560735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:04.568357 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615081a-5e18-401b-81e3-80d4153cea1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:04.569904 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615081a-5e18-401b-81e3-80d4153cea1d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:04.680696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 208/422] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:04.685966 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a856d3-8a6b-444a-adf8-ee0869ea322a None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.745724 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:04.829128 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a856d3-8a6b-444a-adf8-ee0869ea322a None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:04.831468 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615081a-5e18-401b-81e3-80d4153cea1d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.896956 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03a21-61a1-4ca4-b401-1d789a625b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.897861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03a21-61a1-4ca4-b401-1d789a625b65 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.898276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03a21-61a1-4ca4-b401-1d789a625b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.898710 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03a21-61a1-4ca4-b401-1d789a625b65 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.900031 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f03a21-61a1-4ca4-b401-1d789a625b65 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:04.902776 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f03a21-61a1-4ca4-b401-1d789a625b65 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:04.907419 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 215/423] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:04.914384 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03a21-61a1-4ca4-b401-1d789a625b65 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.988078 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:04.994777 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615081a-5e18-401b-81e3-80d4153cea1d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.033187 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c1962-baf7-41d4-8b2a-de6f9f08c4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.033729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c1962-baf7-41d4-8b2a-de6f9f08c4ae None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.033998 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c1962-baf7-41d4-8b2a-de6f9f08c4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.034262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c1962-baf7-41d4-8b2a-de6f9f08c4ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.053166 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c1962-baf7-41d4-8b2a-de6f9f08c4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-8b0c1962-baf7-41d4-8b2a-de6f9f08c4ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:05.061499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:05.062423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:05.063335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 209/424] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:05.070534 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c1962-baf7-41d4-8b2a-de6f9f08c4ae None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.122569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03a21-61a1-4ca4-b401-1d789a625b65 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.126274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.190065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa976d-a27c-4872-a6ac-39c50662bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.190702 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa976d-a27c-4872-a6ac-39c50662bd64 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.190971 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa976d-a27c-4872-a6ac-39c50662bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.191237 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa976d-a27c-4872-a6ac-39c50662bd64 None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.195813 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa976d-a27c-4872-a6ac-39c50662bd64 None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.197873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa976d-a27c-4872-a6ac-39c50662bd64 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.199627 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 216/425] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:05.205492 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa976d-a27c-4872-a6ac-39c50662bd64 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.243830 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c1962-baf7-41d4-8b2a-de6f9f08c4ae None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.279651 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3794592-9f5d-4aef-bebe-ff8ad8b73702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.280013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794592-9f5d-4aef-bebe-ff8ad8b73702 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.280254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794592-9f5d-4aef-bebe-ff8ad8b73702 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.280524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794592-9f5d-4aef-bebe-ff8ad8b73702 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.281175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3794592-9f5d-4aef-bebe-ff8ad8b73702 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:05.281468 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3794592-9f5d-4aef-bebe-ff8ad8b73702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.282860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3794592-9f5d-4aef-bebe-ff8ad8b73702 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.295881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 210/426] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:05.298892 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3794592-9f5d-4aef-bebe-ff8ad8b73702 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.346012 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.352758 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa976d-a27c-4872-a6ac-39c50662bd64 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.438434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b976b7-5010-4d66-9977-571d8841f7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.440709 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b976b7-5010-4d66-9977-571d8841f7ab None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.442536 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b976b7-5010-4d66-9977-571d8841f7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.443192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b976b7-5010-4d66-9977-571d8841f7ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.444241 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b976b7-5010-4d66-9977-571d8841f7ab None admin] RBAC: Adding query filter params (group.id=52f150a50df6488cb3bd50c79106dd1e, role.id=fa4a34a109e44660bbce4320a4c9a366, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:05.445709 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b976b7-5010-4d66-9977-571d8841f7ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.447343 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b976b7-5010-4d66-9977-571d8841f7ab None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.461034 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 217/427] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Oct 9 00:43:05 2022] GET /identity/v3/role_assignments?group.id=52f150a50df6488cb3bd50c79106dd1e&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 611 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:05.469080 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3794592-9f5d-4aef-bebe-ff8ad8b73702 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.477295 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c7ff-5b80-4f00-ac4c-e61f0af3d50e None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.477584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c7ff-5b80-4f00-ac4c-e61f0af3d50e None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.477827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c7ff-5b80-4f00-ac4c-e61f0af3d50e None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.483742 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 218/428] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:05.485703 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78917edf-ce7e-4169-8892-f706ff53d821 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.485985 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78917edf-ce7e-4169-8892-f706ff53d821 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.486251 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78917edf-ce7e-4169-8892-f706ff53d821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.523293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ebb7e-0983-43f4-bd81-83cde53c8630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.524364 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebb7e-0983-43f4-bd81-83cde53c8630 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.524911 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebb7e-0983-43f4-bd81-83cde53c8630 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.525372 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ebb7e-0983-43f4-bd81-83cde53c8630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.526138 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-78917edf-ce7e-4169-8892-f706ff53d821 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:05.527369 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-78917edf-ce7e-4169-8892-f706ff53d821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:05.606615 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ebb7e-0983-43f4-bd81-83cde53c8630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.608558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ebb7e-0983-43f4-bd81-83cde53c8630 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.617622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.660506 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.732468 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 211/429] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:05.735035 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ebb7e-0983-43f4-bd81-83cde53c8630 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.752181 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 219/430] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:05.840909 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ebb7e-0983-43f4-bd81-83cde53c8630 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.876722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62945d5-2b6b-475e-a78e-eff85e07c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.877721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.878183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62945d5-2b6b-475e-a78e-eff85e07c620 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.878656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62945d5-2b6b-475e-a78e-eff85e07c620 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.879131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62945d5-2b6b-475e-a78e-eff85e07c620 None admin] PATH_INFO: `/v3/projects/24d37c4bb9ee4e17addb93014168fbdf` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.880684 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62945d5-2b6b-475e-a78e-eff85e07c620 None admin] RBAC: Authorizing `identity:get_project(project_id=24d37c4bb9ee4e17addb93014168fbdf)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.882793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62945d5-2b6b-475e-a78e-eff85e07c620 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.885050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 212/431] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:05 2022] GET /identity/v3/projects/24d37c4bb9ee4e17addb93014168fbdf => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:05.893169 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78917edf-ce7e-4169-8892-f706ff53d821 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.999218 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78917edf-ce7e-4169-8892-f706ff53d821 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.035302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936e0f-3d91-4f9f-9a0b-e26d43fc0766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.036316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936e0f-3d91-4f9f-9a0b-e26d43fc0766 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.036846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936e0f-3d91-4f9f-9a0b-e26d43fc0766 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.037348 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936e0f-3d91-4f9f-9a0b-e26d43fc0766 None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.039040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68936e0f-3d91-4f9f-9a0b-e26d43fc0766 None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.039234 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62945d5-2b6b-475e-a78e-eff85e07c620 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.041335 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68936e0f-3d91-4f9f-9a0b-e26d43fc0766 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:06.044635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 220/432] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:43:05 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:06.051696 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936e0f-3d91-4f9f-9a0b-e26d43fc0766 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.096684 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.149727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62945d5-2b6b-475e-a78e-eff85e07c620 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.188535 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936e0f-3d91-4f9f-9a0b-e26d43fc0766 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.189342 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b8270-23f1-4aab-91ae-f47af7b92203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.190067 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b8270-23f1-4aab-91ae-f47af7b92203 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.193690 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b8270-23f1-4aab-91ae-f47af7b92203 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.194051 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b8270-23f1-4aab-91ae-f47af7b92203 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.218918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b8270-23f1-4aab-91ae-f47af7b92203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-924b8270-23f1-4aab-91ae-f47af7b92203 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:06.227718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:06.228794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:43:06.229612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:06.234446 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 213/433] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:06.235436 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b8270-23f1-4aab-91ae-f47af7b92203 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.243276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346762af-c0f0-4c6c-a6db-4d33e1f098fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.243276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346762af-c0f0-4c6c-a6db-4d33e1f098fa None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.243276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346762af-c0f0-4c6c-a6db-4d33e1f098fa None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.243276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346762af-c0f0-4c6c-a6db-4d33e1f098fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.244003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346762af-c0f0-4c6c-a6db-4d33e1f098fa None admin] RBAC: Adding query filter params (group.id=52f150a50df6488cb3bd50c79106dd1e, role.id=d796a9636e044b848ecdc0f80ee9443d, scope.project.id=24d37c4bb9ee4e17addb93014168fbdf) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:06.244347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346762af-c0f0-4c6c-a6db-4d33e1f098fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.245848 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346762af-c0f0-4c6c-a6db-4d33e1f098fa None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:06.267287 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 221/434] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/role_assignments?group.id=52f150a50df6488cb3bd50c79106dd1e&scope.project.id=24d37c4bb9ee4e17addb93014168fbdf&role.id=d796a9636e044b848ecdc0f80ee9443d => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:06.326876 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.345029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df318a9-e9da-4f78-8cc0-fe53c6a5a491 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.345234 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df318a9-e9da-4f78-8cc0-fe53c6a5a491 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.345325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df318a9-e9da-4f78-8cc0-fe53c6a5a491 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.347031 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 222/435] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:06.353023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39cfdb-7119-4518-abef-5606434199a2 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.353648 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39cfdb-7119-4518-abef-5606434199a2 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.353648 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39cfdb-7119-4518-abef-5606434199a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.375177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-3a39cfdb-7119-4518-abef-5606434199a2 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:06.376736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3a39cfdb-7119-4518-abef-5606434199a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:06.403740 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b8270-23f1-4aab-91ae-f47af7b92203 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.446699 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb73348-7c70-49d3-be53-cc6f38d57688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.447335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73348-7c70-49d3-be53-cc6f38d57688 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.447608 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73348-7c70-49d3-be53-cc6f38d57688 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.448338 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73348-7c70-49d3-be53-cc6f38d57688 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.448685 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb73348-7c70-49d3-be53-cc6f38d57688 None admin] RBAC: Adding query filter params (name=member) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:06.448990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb73348-7c70-49d3-be53-cc6f38d57688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.450420 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb73348-7c70-49d3-be53-cc6f38d57688 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:06.460153 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 214/436] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:06.461440 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf495-f598-473a-9754-f444760ee1d7 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.462094 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf495-f598-473a-9754-f444760ee1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.462475 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf495-f598-473a-9754-f444760ee1d7 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.464098 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 215/437] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:06.467645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bf495-f598-473a-9754-f444760ee1d7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.477059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 223/438] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:43:06.478962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02ad5-ff31-4af9-b985-99f016d57093 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.479246 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02ad5-ff31-4af9-b985-99f016d57093 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.479514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02ad5-ff31-4af9-b985-99f016d57093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.500481 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-92d02ad5-ff31-4af9-b985-99f016d57093 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:06.501662 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-92d02ad5-ff31-4af9-b985-99f016d57093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:06.528117 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.585639 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 224/439] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:06.615991 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bf495-f598-473a-9754-f444760ee1d7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.626532 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.655779 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fba701-d740-4114-8905-50d91e28b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.656339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba701-d740-4114-8905-50d91e28b31d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.656615 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba701-d740-4114-8905-50d91e28b31d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.656881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba701-d740-4114-8905-50d91e28b31d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.730477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fba701-d740-4114-8905-50d91e28b31d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.731964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fba701-d740-4114-8905-50d91e28b31d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:06.783116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d02ad5-ff31-4af9-b985-99f016d57093 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.832525 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 216/440] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 09 00:43:06.838499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fba701-d740-4114-8905-50d91e28b31d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.851020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.891700 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d02ad5-ff31-4af9-b985-99f016d57093 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.924920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbeb5f-0193-4353-ba73-385e036bf9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.925562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbeb5f-0193-4353-ba73-385e036bf9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.925858 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbeb5f-0193-4353-ba73-385e036bf9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.926125 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbeb5f-0193-4353-ba73-385e036bf9e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.937354 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbeb5f-0193-4353-ba73-385e036bf9e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:06.941782 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fba701-d740-4114-8905-50d91e28b31d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-b8bbeb5f-0193-4353-ba73-385e036bf9e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:06.942155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:06.943205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 225/441] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:06.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbeb5f-0193-4353-ba73-385e036bf9e9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.963402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.976939 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb8192-bc5e-4342-bd10-967b558ed31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.977572 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb8192-bc5e-4342-bd10-967b558ed31d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.977849 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb8192-bc5e-4342-bd10-967b558ed31d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.978120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb8192-bc5e-4342-bd10-967b558ed31d None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.979228 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb8192-bc5e-4342-bd10-967b558ed31d None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.980723 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb8192-bc5e-4342-bd10-967b558ed31d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:06.982345 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 217/442] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:06.983095 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb8192-bc5e-4342-bd10-967b558ed31d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.048526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbeb5f-0193-4353-ba73-385e036bf9e9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.064246 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.082254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcb345-313e-4cea-af2a-90dc7b1a5485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.082887 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb345-313e-4cea-af2a-90dc7b1a5485 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.083162 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb345-313e-4cea-af2a-90dc7b1a5485 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.083456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb345-313e-4cea-af2a-90dc7b1a5485 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.088183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb8192-bc5e-4342-bd10-967b558ed31d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.093205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcb345-313e-4cea-af2a-90dc7b1a5485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-cddcb345-313e-4cea-af2a-90dc7b1a5485 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:07.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:07.099064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 226/443] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:07.100319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcb345-313e-4cea-af2a-90dc7b1a5485 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.127309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd341e98-6fef-4fe5-b361-755cefcf3b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.127914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341e98-6fef-4fe5-b361-755cefcf3b4c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.128221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341e98-6fef-4fe5-b361-755cefcf3b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.128488 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341e98-6fef-4fe5-b361-755cefcf3b4c None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.129132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd341e98-6fef-4fe5-b361-755cefcf3b4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:07.129428 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd341e98-6fef-4fe5-b361-755cefcf3b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.130809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd341e98-6fef-4fe5-b361-755cefcf3b4c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.139025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 218/444] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:07.139829 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd341e98-6fef-4fe5-b361-755cefcf3b4c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.181383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.204164 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcb345-313e-4cea-af2a-90dc7b1a5485 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.238092 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbed989-0a06-4e10-95f6-4934b353fd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.238710 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed989-0a06-4e10-95f6-4934b353fd1d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.238980 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed989-0a06-4e10-95f6-4934b353fd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.239243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed989-0a06-4e10-95f6-4934b353fd1d None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.239653 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd341e98-6fef-4fe5-b361-755cefcf3b4c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.240507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbed989-0a06-4e10-95f6-4934b353fd1d None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.241960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbed989-0a06-4e10-95f6-4934b353fd1d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.243703 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 227/445] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:07.244287 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbed989-0a06-4e10-95f6-4934b353fd1d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.275204 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe2802-23d4-4181-9aff-526532238fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.275814 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe2802-23d4-4181-9aff-526532238fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.276105 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe2802-23d4-4181-9aff-526532238fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.276377 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe2802-23d4-4181-9aff-526532238fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.277024 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe2802-23d4-4181-9aff-526532238fd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:07.277320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe2802-23d4-4181-9aff-526532238fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.278708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe2802-23d4-4181-9aff-526532238fd5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.284072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.292366 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 219/446] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:07.293055 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe2802-23d4-4181-9aff-526532238fd5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.345159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbed989-0a06-4e10-95f6-4934b353fd1d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.378040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2085ba-595c-4702-92c4-53d739d474f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.378709 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2085ba-595c-4702-92c4-53d739d474f0 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.378908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2085ba-595c-4702-92c4-53d739d474f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.379176 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2085ba-595c-4702-92c4-53d739d474f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.391126 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe2802-23d4-4181-9aff-526532238fd5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.394438 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.426166 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5391c-e8bd-4bc9-a3ee-36547ce1f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.426780 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5391c-e8bd-4bc9-a3ee-36547ce1f912 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.427119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5391c-e8bd-4bc9-a3ee-36547ce1f912 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.427329 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5391c-e8bd-4bc9-a3ee-36547ce1f912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.428434 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5391c-e8bd-4bc9-a3ee-36547ce1f912 None admin] RBAC: Adding query filter params (group.id=52f150a50df6488cb3bd50c79106dd1e, role.id=fa4a34a109e44660bbce4320a4c9a366, scope.project.id=f8531c2d09da496ab76402401d9fc34b) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:07.428778 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5391c-e8bd-4bc9-a3ee-36547ce1f912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.430616 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5391c-e8bd-4bc9-a3ee-36547ce1f912 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.436472 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 220/447] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/role_assignments?group.id=52f150a50df6488cb3bd50c79106dd1e&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=fa4a34a109e44660bbce4320a4c9a366 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:07.437216 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5391c-e8bd-4bc9-a3ee-36547ce1f912 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.456469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2085ba-595c-4702-92c4-53d739d474f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.457956 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2085ba-595c-4702-92c4-53d739d474f0 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.506761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.552156 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5391c-e8bd-4bc9-a3ee-36547ce1f912 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.571224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 228/448] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:07.576628 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2085ba-595c-4702-92c4-53d739d474f0 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.594276 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6a3e8-b45b-48b8-8a2d-1e0d86f121da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.594899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6a3e8-b45b-48b8-8a2d-1e0d86f121da None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.595176 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6a3e8-b45b-48b8-8a2d-1e0d86f121da None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.595509 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6a3e8-b45b-48b8-8a2d-1e0d86f121da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.626799 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.679908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6a3e8-b45b-48b8-8a2d-1e0d86f121da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.681680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6a3e8-b45b-48b8-8a2d-1e0d86f121da None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.693283 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2085ba-595c-4702-92c4-53d739d474f0 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.733823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017745cf-ce10-4f2f-a49e-81a08299b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.734548 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017745cf-ce10-4f2f-a49e-81a08299b603 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.734827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017745cf-ce10-4f2f-a49e-81a08299b603 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.735096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017745cf-ce10-4f2f-a49e-81a08299b603 None admin] PATH_INFO: `/v3/projects/f8531c2d09da496ab76402401d9fc34b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.736268 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017745cf-ce10-4f2f-a49e-81a08299b603 None admin] RBAC: Authorizing `identity:get_project(project_id=f8531c2d09da496ab76402401d9fc34b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.737696 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017745cf-ce10-4f2f-a49e-81a08299b603 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.739825 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 229/449] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/projects/f8531c2d09da496ab76402401d9fc34b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:07.747250 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017745cf-ce10-4f2f-a49e-81a08299b603 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.751259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.797656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 221/450] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:07.804030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6a3e8-b45b-48b8-8a2d-1e0d86f121da None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.860280 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017745cf-ce10-4f2f-a49e-81a08299b603 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.874588 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.894819 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d38b00-6d6c-4c28-b3b2-017b899c6507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.895434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d38b00-6d6c-4c28-b3b2-017b899c6507 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.895744 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d38b00-6d6c-4c28-b3b2-017b899c6507 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.896073 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d38b00-6d6c-4c28-b3b2-017b899c6507 None admin] PATH_INFO: `/v3/groups/52f150a50df6488cb3bd50c79106dd1e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.897188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d38b00-6d6c-4c28-b3b2-017b899c6507 None admin] RBAC: Authorizing `identity:get_group(group_id=52f150a50df6488cb3bd50c79106dd1e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.898621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d38b00-6d6c-4c28-b3b2-017b899c6507 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.900185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 230/451] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/groups/52f150a50df6488cb3bd50c79106dd1e => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:07.905969 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d38b00-6d6c-4c28-b3b2-017b899c6507 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.906112 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6a3e8-b45b-48b8-8a2d-1e0d86f121da None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.940772 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a5cc-f0b4-4eb1-8c85-16aa52dc1553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.941479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a5cc-f0b4-4eb1-8c85-16aa52dc1553 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.941756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a5cc-f0b4-4eb1-8c85-16aa52dc1553 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.942022 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a5cc-f0b4-4eb1-8c85-16aa52dc1553 None admin] PATH_INFO: `/v3/projects/b4515502f4ca44c3b302803eb9e3faf6` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.943438 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7a5cc-f0b4-4eb1-8c85-16aa52dc1553 None admin] RBAC: Authorizing `identity:get_project(project_id=b4515502f4ca44c3b302803eb9e3faf6)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.945063 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7a5cc-f0b4-4eb1-8c85-16aa52dc1553 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.946714 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 222/452] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/projects/b4515502f4ca44c3b302803eb9e3faf6 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:07.952378 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a5cc-f0b4-4eb1-8c85-16aa52dc1553 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.982308 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:08.002564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d38b00-6d6c-4c28-b3b2-017b899c6507 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:08.035799 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e58de0-19cf-4403-bf53-76e54cba8228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:08.036427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e58de0-19cf-4403-bf53-76e54cba8228 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.036820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e58de0-19cf-4403-bf53-76e54cba8228 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.037172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e58de0-19cf-4403-bf53-76e54cba8228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.037906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e58de0-19cf-4403-bf53-76e54cba8228 None admin] RBAC: Adding query filter params (group.id=52f150a50df6488cb3bd50c79106dd1e, role.id=d796a9636e044b848ecdc0f80ee9443d, scope.project.id=f8531c2d09da496ab76402401d9fc34b) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:08.038208 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e58de0-19cf-4403-bf53-76e54cba8228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:08.039640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e58de0-19cf-4403-bf53-76e54cba8228 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:08.045445 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 231/453] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/role_assignments?group.id=52f150a50df6488cb3bd50c79106dd1e&scope.project.id=f8531c2d09da496ab76402401d9fc34b&role.id=d796a9636e044b848ecdc0f80ee9443d => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:08.053282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a5cc-f0b4-4eb1-8c85-16aa52dc1553 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:08.092140 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e533ff-3844-4e1c-ac9b-d44f40d2e36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:08.092863 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e533ff-3844-4e1c-ac9b-d44f40d2e36c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.093009 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e533ff-3844-4e1c-ac9b-d44f40d2e36c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.093314 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e533ff-3844-4e1c-ac9b-d44f40d2e36c None admin] PATH_INFO: `/v3/groups/a9421988ba5d442a985a1700a3e07722` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.094510 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e533ff-3844-4e1c-ac9b-d44f40d2e36c None admin] RBAC: Authorizing `identity:get_group(group_id=a9421988ba5d442a985a1700a3e07722)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:08.095992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e533ff-3844-4e1c-ac9b-d44f40d2e36c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:08.097675 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 223/454] 10.222.0.43 () {56 vars in 1180 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/groups/a9421988ba5d442a985a1700a3e07722 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:08.104507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e58de0-19cf-4403-bf53-76e54cba8228 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:08.157611 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:08.216749 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e58de0-19cf-4403-bf53-76e54cba8228 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:08.252220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26933e-301c-412e-82b4-0fea92561b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:08.252820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26933e-301c-412e-82b4-0fea92561b92 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.253095 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26933e-301c-412e-82b4-0fea92561b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.253369 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26933e-301c-412e-82b4-0fea92561b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.254089 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26933e-301c-412e-82b4-0fea92561b92 None admin] RBAC: Adding query filter params (group.id=a9421988ba5d442a985a1700a3e07722, role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=b4515502f4ca44c3b302803eb9e3faf6) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:08.254408 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26933e-301c-412e-82b4-0fea92561b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:08.255949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26933e-301c-412e-82b4-0fea92561b92 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:08.262382 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 232/455] 10.222.0.43 () {56 vars in 1376 bytes} [Sun Oct 9 00:43:08 2022] GET /identity/v3/role_assignments?group.id=a9421988ba5d442a985a1700a3e07722&scope.project.id=b4515502f4ca44c3b302803eb9e3faf6&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:11.006516 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6d937-959c-4dc3-bc17-2dbbcecdf8e4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.007068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6d937-959c-4dc3-bc17-2dbbcecdf8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.007068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6d937-959c-4dc3-bc17-2dbbcecdf8e4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.009049 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 224/456] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:11.014445 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb431bd8-e74d-46b1-b988-cea91e495951 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.014844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb431bd8-e74d-46b1-b988-cea91e495951 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.015069 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb431bd8-e74d-46b1-b988-cea91e495951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.041040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-bb431bd8-e74d-46b1-b988-cea91e495951 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:11.042283 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-bb431bd8-e74d-46b1-b988-cea91e495951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:11.052951 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb490-446d-40ba-8259-39521e1d3ab2 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.053589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb490-446d-40ba-8259-39521e1d3ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.054082 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb490-446d-40ba-8259-39521e1d3ab2 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.055951 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 225/457] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:11.061543 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1fff8-edbf-4a21-a4e0-5dc65998d82a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.062046 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1fff8-edbf-4a21-a4e0-5dc65998d82a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.062510 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1fff8-edbf-4a21-a4e0-5dc65998d82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.083771 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-25e1fff8-edbf-4a21-a4e0-5dc65998d82a None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:11.086927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-25e1fff8-edbf-4a21-a4e0-5dc65998d82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:11.157431 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 233/458] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:11.188203 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 226/459] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:43:11.340998 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f9155-e04c-4f6f-ae70-f2cba106778f None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.341241 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f9155-e04c-4f6f-ae70-f2cba106778f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.341682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f9155-e04c-4f6f-ae70-f2cba106778f None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.343381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 234/460] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:11.348814 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee672fed-0bae-4fc5-94b2-dc348ce6f15d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.349368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee672fed-0bae-4fc5-94b2-dc348ce6f15d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.349871 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee672fed-0bae-4fc5-94b2-dc348ce6f15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.375293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ee672fed-0bae-4fc5-94b2-dc348ce6f15d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:11.376858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ee672fed-0bae-4fc5-94b2-dc348ce6f15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:11.406349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:11.470723 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 227/461] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:11.500164 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f9155-e04c-4f6f-ae70-f2cba106778f None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.556005 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:11.620195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee672fed-0bae-4fc5-94b2-dc348ce6f15d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.629960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f9155-e04c-4f6f-ae70-f2cba106778f None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.666386 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666c64-8746-4d40-b60e-51fbd6ab5425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.667027 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666c64-8746-4d40-b60e-51fbd6ab5425 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.667300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666c64-8746-4d40-b60e-51fbd6ab5425 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.667568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666c64-8746-4d40-b60e-51fbd6ab5425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.678182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a666c64-8746-4d40-b60e-51fbd6ab5425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:11.679639 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a666c64-8746-4d40-b60e-51fbd6ab5425 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-5a666c64-8746-4d40-b60e-51fbd6ab5425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:11.694225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:11.695193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:11.696499 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:11.696499 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:11.696499 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:11.696499 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 235/462] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:11.707271 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666c64-8746-4d40-b60e-51fbd6ab5425 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.778627 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee672fed-0bae-4fc5-94b2-dc348ce6f15d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.814945 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9a21b-9105-4bb0-9915-ff64f3b719ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.815582 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9a21b-9105-4bb0-9915-ff64f3b719ca None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.815861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9a21b-9105-4bb0-9915-ff64f3b719ca None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.816570 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9a21b-9105-4bb0-9915-ff64f3b719ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.819862 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:11.827737 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9a21b-9105-4bb0-9915-ff64f3b719ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:11.829254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9a21b-9105-4bb0-9915-ff64f3b719ca None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:11.829851 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666c64-8746-4d40-b60e-51fbd6ab5425 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-01e9a21b-9105-4bb0-9915-ff64f3b719ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:11.846168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:11.847180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:11.853770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:11.853770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:11.853770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:11.853770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 228/463] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:11.853770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9a21b-9105-4bb0-9915-ff64f3b719ca None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.863747 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:11.874033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78012c-63c6-42f5-b3cc-d04e20175519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.874579 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78012c-63c6-42f5-b3cc-d04e20175519 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.874839 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78012c-63c6-42f5-b3cc-d04e20175519 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.875101 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78012c-63c6-42f5-b3cc-d04e20175519 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.875733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78012c-63c6-42f5-b3cc-d04e20175519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:11.876118 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78012c-63c6-42f5-b3cc-d04e20175519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:11.877519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78012c-63c6-42f5-b3cc-d04e20175519 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:11.889867 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 236/464] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:11.890892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860511e9-15bf-42f0-afbb-b2b5349a0f35 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.891180 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860511e9-15bf-42f0-afbb-b2b5349a0f35 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.891500 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860511e9-15bf-42f0-afbb-b2b5349a0f35 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.892710 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 237/465] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:11.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860511e9-15bf-42f0-afbb-b2b5349a0f35 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.963916 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9a21b-9105-4bb0-9915-ff64f3b719ca None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.999214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f7fa6-08fd-4238-aca7-9ecad797a9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.999420 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860511e9-15bf-42f0-afbb-b2b5349a0f35 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.999847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f7fa6-08fd-4238-aca7-9ecad797a9ee None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.000150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f7fa6-08fd-4238-aca7-9ecad797a9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.000426 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f7fa6-08fd-4238-aca7-9ecad797a9ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.011251 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f7fa6-08fd-4238-aca7-9ecad797a9ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:12.012749 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f7fa6-08fd-4238-aca7-9ecad797a9ee None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-311f7fa6-08fd-4238-aca7-9ecad797a9ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:12.029272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:12.030269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:12.031157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:12.031157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:12.031157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:12.031157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 229/466] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:12.031856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f7fa6-08fd-4238-aca7-9ecad797a9ee None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:12.040730 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3139d-1e0a-45e3-98a8-b2b2626842bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:12.041356 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3139d-1e0a-45e3-98a8-b2b2626842bc None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.041618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3139d-1e0a-45e3-98a8-b2b2626842bc None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.041886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3139d-1e0a-45e3-98a8-b2b2626842bc None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.042622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3139d-1e0a-45e3-98a8-b2b2626842bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:12.042927 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3139d-1e0a-45e3-98a8-b2b2626842bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:12.044341 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3139d-1e0a-45e3-98a8-b2b2626842bc None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:12.060515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 238/467] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:12.060515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b435c54-1781-4435-8ea3-7da23b159dab None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.060515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b435c54-1781-4435-8ea3-7da23b159dab None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.060515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b435c54-1781-4435-8ea3-7da23b159dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.077875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-1b435c54-1781-4435-8ea3-7da23b159dab None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:12.079288 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-1b435c54-1781-4435-8ea3-7da23b159dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:12.086955 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:12.100212 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:12.142399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f7fa6-08fd-4238-aca7-9ecad797a9ee None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:12.151488 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 239/468] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:12.152416 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b435c54-1781-4435-8ea3-7da23b159dab None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:12.189229 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed47c1b-3fb2-4b79-8a9f-5ef1c1a4c070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:12.190193 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed47c1b-3fb2-4b79-8a9f-5ef1c1a4c070 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.190666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed47c1b-3fb2-4b79-8a9f-5ef1c1a4c070 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.191130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed47c1b-3fb2-4b79-8a9f-5ef1c1a4c070 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.192146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed47c1b-3fb2-4b79-8a9f-5ef1c1a4c070 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:12.194129 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed47c1b-3fb2-4b79-8a9f-5ef1c1a4c070 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:12.219103 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 230/469] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:43:12 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:12.220427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed47c1b-3fb2-4b79-8a9f-5ef1c1a4c070 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:12.261928 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b435c54-1781-4435-8ea3-7da23b159dab None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:12.302058 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a8c3c-f27e-4b38-967e-55e9edb0e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:12.303479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a8c3c-f27e-4b38-967e-55e9edb0e3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.303479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a8c3c-f27e-4b38-967e-55e9edb0e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.303680 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a8c3c-f27e-4b38-967e-55e9edb0e3b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.304365 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a8c3c-f27e-4b38-967e-55e9edb0e3b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:12.304659 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a8c3c-f27e-4b38-967e-55e9edb0e3b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:12.306062 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a8c3c-f27e-4b38-967e-55e9edb0e3b7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:12.328146 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 240/470] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:12.336207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a8c3c-f27e-4b38-967e-55e9edb0e3b7 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:12.341896 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:12.351331 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed47c1b-3fb2-4b79-8a9f-5ef1c1a4c070 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:12.374158 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:12.392493 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf240209-084a-4463-b699-dd0986854778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:12.393211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf240209-084a-4463-b699-dd0986854778 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.394041 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf240209-084a-4463-b699-dd0986854778 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.394415 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf240209-084a-4463-b699-dd0986854778 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.395326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf240209-084a-4463-b699-dd0986854778 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:12.397267 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf240209-084a-4463-b699-dd0986854778 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:12.428226 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 231/471] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:43:12 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:12.429773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb817-8cf3-4753-aa30-1dd1d3884335 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.431121 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb817-8cf3-4753-aa30-1dd1d3884335 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.431406 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb817-8cf3-4753-aa30-1dd1d3884335 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.432917 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 232/472] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:12.439458 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91ada3-0f94-4c09-9158-228cb8eee885 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.439765 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91ada3-0f94-4c09-9158-228cb8eee885 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.439997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91ada3-0f94-4c09-9158-228cb8eee885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.469364 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6a91ada3-0f94-4c09-9158-228cb8eee885 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:12.471312 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6a91ada3-0f94-4c09-9158-228cb8eee885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:12.507796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a8c3c-f27e-4b38-967e-55e9edb0e3b7 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:12.550584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1e3cd-13f5-4346-841f-d8e1553aca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:12.551365 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1e3cd-13f5-4346-841f-d8e1553aca47 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.551708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1e3cd-13f5-4346-841f-d8e1553aca47 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.552159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1e3cd-13f5-4346-841f-d8e1553aca47 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.553066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1e3cd-13f5-4346-841f-d8e1553aca47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:12.554823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1e3cd-13f5-4346-841f-d8e1553aca47 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:12.572749 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 233/473] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:43:12.586978 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 241/474] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:43:12 2022] POST /identity/v3/users => generated 248 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:43:12.611961 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91ada3-0f94-4c09-9158-228cb8eee885 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:12.730156 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91ada3-0f94-4c09-9158-228cb8eee885 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:12.738983 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:12.778764 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11d504-e196-45ab-ba1d-7bafe28f1002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:12.779414 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11d504-e196-45ab-ba1d-7bafe28f1002 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.779739 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11d504-e196-45ab-ba1d-7bafe28f1002 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.780002 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11d504-e196-45ab-ba1d-7bafe28f1002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.798678 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11d504-e196-45ab-ba1d-7bafe28f1002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:12.800205 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11d504-e196-45ab-ba1d-7bafe28f1002 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-db11d504-e196-45ab-ba1d-7bafe28f1002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:12.815927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:12.816954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:12.818062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:12.818062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:12.818062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:12.818062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 234/475] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:12.824814 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1e3cd-13f5-4346-841f-d8e1553aca47 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:12.895215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:12.920512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11d504-e196-45ab-ba1d-7bafe28f1002 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:12.955005 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1e3cd-13f5-4346-841f-d8e1553aca47 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:12.998519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52697a17-c088-42cf-8c3d-15550451aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:12.999511 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52697a17-c088-42cf-8c3d-15550451aae4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:13.000181 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52697a17-c088-42cf-8c3d-15550451aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:13.000988 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52697a17-c088-42cf-8c3d-15550451aae4 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:13.002122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52697a17-c088-42cf-8c3d-15550451aae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:13.002617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52697a17-c088-42cf-8c3d-15550451aae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:13.006219 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52697a17-c088-42cf-8c3d-15550451aae4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:13.020702 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 242/476] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:13.026753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52697a17-c088-42cf-8c3d-15550451aae4 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:13.051662 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11d504-e196-45ab-ba1d-7bafe28f1002 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:13.088647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0301d-35fe-47e2-a41c-c4440a65c4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:13.089680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0301d-35fe-47e2-a41c-c4440a65c4e6 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:13.090157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0301d-35fe-47e2-a41c-c4440a65c4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:13.090622 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0301d-35fe-47e2-a41c-c4440a65c4e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:13.091569 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0301d-35fe-47e2-a41c-c4440a65c4e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:13.093254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0301d-35fe-47e2-a41c-c4440a65c4e6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:13.103315 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.sql.core [None req-c6d0301d-35fe-47e2-a41c-c4440a65c4e6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 09 00:43:13.103315 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 09 00:43:13.103315 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [parameters: {'id': '13d61792ea4e426a9dfd8c08cad2aa62', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 09 00:43:13.103315 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81519) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-c6d0301d-35fe-47e2-a41c-c4440a65c4e6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application result.read() Oct 09 00:43:13.124169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return ref.to_dict() Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:43:13.125130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application yield resource Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self.session.rollback() Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self.force_reraise() Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise self.value Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application session.commit() Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 09 00:43:13.126175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._prepare_impl() Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self.session.flush() Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._flush(objects) Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application compat.raise_( Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application flush_context.execute() Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rec.execute(self) Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 09 00:43:13.127114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:43:13.128029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application result.read() Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:43:13.128914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [parameters: {'id': '13d61792ea4e426a9dfd8c08cad2aa62', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:13.129738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 09 00:43:13.130694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:13.136196 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 235/477] 10.222.0.43 () {60 vars in 1131 bytes} [Sun Oct 9 00:43:12 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:13.142469 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0301d-35fe-47e2-a41c-c4440a65c4e6 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:13.197887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:13.271037 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52697a17-c088-42cf-8c3d-15550451aae4 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:13.309069 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:13.336571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0301d-35fe-47e2-a41c-c4440a65c4e6 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:13.344499 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e806fd2-50d5-4019-9f10-2880bc12c034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:13.345116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e806fd2-50d5-4019-9f10-2880bc12c034 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:13.345389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e806fd2-50d5-4019-9f10-2880bc12c034 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:13.345655 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e806fd2-50d5-4019-9f10-2880bc12c034 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:13.346378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e806fd2-50d5-4019-9f10-2880bc12c034 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:13.347862 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e806fd2-50d5-4019-9f10-2880bc12c034 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:13.384558 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 243/478] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:43:13 2022] POST /identity/v3/users => generated 249 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:43:13.395852 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcd130-8b7d-4282-aa8d-632649ed058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:13.397034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcd130-8b7d-4282-aa8d-632649ed058f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:13.397372 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcd130-8b7d-4282-aa8d-632649ed058f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:13.397688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcd130-8b7d-4282-aa8d-632649ed058f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:13.409984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcd130-8b7d-4282-aa8d-632649ed058f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-6dbcd130-8b7d-4282-aa8d-632649ed058f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:13.415899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:13.416927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:13.417940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 236/479] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:13.425095 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e806fd2-50d5-4019-9f10-2880bc12c034 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:13.549755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e806fd2-50d5-4019-9f10-2880bc12c034 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:13.601454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cb383-11a6-45ef-a2c7-84ee143e5859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:13.602244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb383-11a6-45ef-a2c7-84ee143e5859 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:13.602620 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb383-11a6-45ef-a2c7-84ee143e5859 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:13.602984 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb383-11a6-45ef-a2c7-84ee143e5859 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:13.603761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cb383-11a6-45ef-a2c7-84ee143e5859 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:13.604195 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cb383-11a6-45ef-a2c7-84ee143e5859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:13.605765 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cb383-11a6-45ef-a2c7-84ee143e5859 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:13.615847 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 244/480] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:14.970210 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04bac6-79b9-4927-a9db-127fc3cfd55f None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:14.971256 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04bac6-79b9-4927-a9db-127fc3cfd55f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:14.971731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04bac6-79b9-4927-a9db-127fc3cfd55f None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:14.973548 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 237/481] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:14.979657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a16c8-20c7-456e-9f4a-32bfa38d8b5e None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:14.980103 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a16c8-20c7-456e-9f4a-32bfa38d8b5e None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:14.980279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a16c8-20c7-456e-9f4a-32bfa38d8b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.009939 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-766a16c8-20c7-456e-9f4a-32bfa38d8b5e None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:15.011126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-766a16c8-20c7-456e-9f4a-32bfa38d8b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:15.053503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:15.102644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 245/482] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:15.243539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da111aad-dc8c-4f9d-bbf6-516e31d65268 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.243883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da111aad-dc8c-4f9d-bbf6-516e31d65268 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.244088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da111aad-dc8c-4f9d-bbf6-516e31d65268 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.245681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 238/483] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:15.250962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b6237-ddb3-406e-9cf0-29280df3e52f None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.251239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b6237-ddb3-406e-9cf0-29280df3e52f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.251503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b6237-ddb3-406e-9cf0-29280df3e52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.278008 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-ae7b6237-ddb3-406e-9cf0-29280df3e52f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:15.279184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-ae7b6237-ddb3-406e-9cf0-29280df3e52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:15.344996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 246/484] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:15.494412 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da111aad-dc8c-4f9d-bbf6-516e31d65268 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.592216 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:15.611659 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da111aad-dc8c-4f9d-bbf6-516e31d65268 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:15.636492 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b6237-ddb3-406e-9cf0-29280df3e52f None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.667562 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69a215-69d1-489b-aea6-05584a4e4a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:15.668215 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69a215-69d1-489b-aea6-05584a4e4a46 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.668484 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69a215-69d1-489b-aea6-05584a4e4a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.668748 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69a215-69d1-489b-aea6-05584a4e4a46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.680990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69a215-69d1-489b-aea6-05584a4e4a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-8a69a215-69d1-489b-aea6-05584a4e4a46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:15.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:15.687545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:15.688409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 239/485] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:15.701099 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69a215-69d1-489b-aea6-05584a4e4a46 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.770060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:15.782725 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b6237-ddb3-406e-9cf0-29280df3e52f None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:15.823932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704189f-36ac-4e47-a665-5f60db7b5371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:15.824983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704189f-36ac-4e47-a665-5f60db7b5371 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.825437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704189f-36ac-4e47-a665-5f60db7b5371 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.825981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704189f-36ac-4e47-a665-5f60db7b5371 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.827355 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69a215-69d1-489b-aea6-05584a4e4a46 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:15.838275 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704189f-36ac-4e47-a665-5f60db7b5371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-6704189f-36ac-4e47-a665-5f60db7b5371 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:15.843863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:15.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:15.846018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:15.848372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 247/486] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:15.849957 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ebf9-7bd3-4b3e-a50e-e352d40fc62c None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.850490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ebf9-7bd3-4b3e-a50e-e352d40fc62c None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.851428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ebf9-7bd3-4b3e-a50e-e352d40fc62c None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.852868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 248/487] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:15.855933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633ebf9-7bd3-4b3e-a50e-e352d40fc62c None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.872586 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faed724-c566-4913-8593-b1b4f4115721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:15.873121 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed724-c566-4913-8593-b1b4f4115721 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.873397 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed724-c566-4913-8593-b1b4f4115721 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.873667 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed724-c566-4913-8593-b1b4f4115721 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.874334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faed724-c566-4913-8593-b1b4f4115721 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:15.874634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faed724-c566-4913-8593-b1b4f4115721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:15.876034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faed724-c566-4913-8593-b1b4f4115721 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:15.889640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 240/488] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:15.891320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a02353-a1be-4b2e-91e3-cf320bdfdcea None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.891795 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a02353-a1be-4b2e-91e3-cf320bdfdcea None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.892316 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a02353-a1be-4b2e-91e3-cf320bdfdcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.902385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:15.920076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-e6a02353-a1be-4b2e-91e3-cf320bdfdcea None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:15.922216 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e6a02353-a1be-4b2e-91e3-cf320bdfdcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:15.976692 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633ebf9-7bd3-4b3e-a50e-e352d40fc62c None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.012298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734b79c-dd17-47c0-a47e-5b8a9c376537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.012968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734b79c-dd17-47c0-a47e-5b8a9c376537 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.013193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734b79c-dd17-47c0-a47e-5b8a9c376537 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.013576 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734b79c-dd17-47c0-a47e-5b8a9c376537 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.013794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 241/489] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:16.014182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734b79c-dd17-47c0-a47e-5b8a9c376537 None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:16.014393 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734b79c-dd17-47c0-a47e-5b8a9c376537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.015389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a02353-a1be-4b2e-91e3-cf320bdfdcea None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.015759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734b79c-dd17-47c0-a47e-5b8a9c376537 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.031507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 249/490] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:16.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734b79c-dd17-47c0-a47e-5b8a9c376537 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.097123 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.150118 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a02353-a1be-4b2e-91e3-cf320bdfdcea None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.188262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceda30-4317-485d-a1e2-e96dca9ccccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.189722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceda30-4317-485d-a1e2-e96dca9ccccf None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.190188 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceda30-4317-485d-a1e2-e96dca9ccccf None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.190835 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceda30-4317-485d-a1e2-e96dca9ccccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.193682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.205187 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ceda30-4317-485d-a1e2-e96dca9ccccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.207286 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ceda30-4317-485d-a1e2-e96dca9ccccf None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-79ceda30-4317-485d-a1e2-e96dca9ccccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:16.241400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:16.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:16.243264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:16.243264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:16.243264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:16.243264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 242/491] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:16.249452 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5957c-a1a9-41b6-8468-48312a48ee70 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.249733 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5957c-a1a9-41b6-8468-48312a48ee70 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.250011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5957c-a1a9-41b6-8468-48312a48ee70 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.251649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 243/492] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:16.252330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5957c-a1a9-41b6-8468-48312a48ee70 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.274274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734b79c-dd17-47c0-a47e-5b8a9c376537 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.319525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34ca19-1b7d-45d3-b57d-ab4604d24ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.320188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34ca19-1b7d-45d3-b57d-ab4604d24ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.320461 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34ca19-1b7d-45d3-b57d-ab4604d24ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.320725 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34ca19-1b7d-45d3-b57d-ab4604d24ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.331235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34ca19-1b7d-45d3-b57d-ab4604d24ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.332684 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34ca19-1b7d-45d3-b57d-ab4604d24ba9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-9f34ca19-1b7d-45d3-b57d-ab4604d24ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:16.346719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:16.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:16.348616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:16.348616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:16.348616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:16.348616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 250/493] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:16.349309 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb41f17-37fc-4418-8ffe-2c871000884f None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.349417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb41f17-37fc-4418-8ffe-2c871000884f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.349597 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb41f17-37fc-4418-8ffe-2c871000884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.369599 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-3eb41f17-37fc-4418-8ffe-2c871000884f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:16.370337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5957c-a1a9-41b6-8468-48312a48ee70 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.370751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3eb41f17-37fc-4418-8ffe-2c871000884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:16.406921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f05198-b764-483d-8a59-339caa634ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.407433 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f05198-b764-483d-8a59-339caa634ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.407709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f05198-b764-483d-8a59-339caa634ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.407976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f05198-b764-483d-8a59-339caa634ca8 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.408640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f05198-b764-483d-8a59-339caa634ca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:16.408939 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f05198-b764-483d-8a59-339caa634ca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.410313 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f05198-b764-483d-8a59-339caa634ca8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.428310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 244/494] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:16.433269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f05198-b764-483d-8a59-339caa634ca8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.436578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.443213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 251/495] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:16.444131 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb41f17-37fc-4418-8ffe-2c871000884f None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.483681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.542758 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f05198-b764-483d-8a59-339caa634ca8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.553273 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb41f17-37fc-4418-8ffe-2c871000884f None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.577698 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c53ad5-f942-4bbc-aa6c-34630feb11f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.578270 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53ad5-f942-4bbc-aa6c-34630feb11f8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.578542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53ad5-f942-4bbc-aa6c-34630feb11f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.578817 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53ad5-f942-4bbc-aa6c-34630feb11f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.587787 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed345f7-79fc-4d03-8b76-8cf0561bfb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.588544 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed345f7-79fc-4d03-8b76-8cf0561bfb4f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.588721 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed345f7-79fc-4d03-8b76-8cf0561bfb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.588974 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed345f7-79fc-4d03-8b76-8cf0561bfb4f None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.589619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed345f7-79fc-4d03-8b76-8cf0561bfb4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:16.589906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed345f7-79fc-4d03-8b76-8cf0561bfb4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.590085 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c53ad5-f942-4bbc-aa6c-34630feb11f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:16.591203 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed345f7-79fc-4d03-8b76-8cf0561bfb4f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-95c53ad5-f942-4bbc-aa6c-34630feb11f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:16.595207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:16.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:16.596992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:16.601473 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 245/496] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:16.602498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c72619-251c-4f7a-bbb5-87bb2d39f4e2 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.602783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c72619-251c-4f7a-bbb5-87bb2d39f4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.603054 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c72619-251c-4f7a-bbb5-87bb2d39f4e2 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.608657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 252/497] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:16.608657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed345f7-79fc-4d03-8b76-8cf0561bfb4f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.608874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 246/498] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:16.608874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c72619-251c-4f7a-bbb5-87bb2d39f4e2 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.673208 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.712922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c72619-251c-4f7a-bbb5-87bb2d39f4e2 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.716642 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed345f7-79fc-4d03-8b76-8cf0561bfb4f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.720864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.747674 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81f78-37bd-4237-984b-a52ae184a36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.748301 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81f78-37bd-4237-984b-a52ae184a36e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.748580 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81f78-37bd-4237-984b-a52ae184a36e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.748852 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81f78-37bd-4237-984b-a52ae184a36e None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.749402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617da41-cd37-4091-aa27-13f0b0b68f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.749508 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c81f78-37bd-4237-984b-a52ae184a36e None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:16.749790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c81f78-37bd-4237-984b-a52ae184a36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.750021 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617da41-cd37-4091-aa27-13f0b0b68f4d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.750324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617da41-cd37-4091-aa27-13f0b0b68f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.750583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617da41-cd37-4091-aa27-13f0b0b68f4d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.751230 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c81f78-37bd-4237-984b-a52ae184a36e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.758454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617da41-cd37-4091-aa27-13f0b0b68f4d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.759652 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 247/499] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:16.759828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617da41-cd37-4091-aa27-13f0b0b68f4d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.760480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81f78-37bd-4237-984b-a52ae184a36e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-4617da41-cd37-4091-aa27-13f0b0b68f4d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:16.777346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:16.778457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 253/500] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d94063-3b55-4db6-b2d4-c72ea7f960aa None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.779831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d94063-3b55-4db6-b2d4-c72ea7f960aa None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.780687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d94063-3b55-4db6-b2d4-c72ea7f960aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.800696 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-b4d94063-3b55-4db6-b2d4-c72ea7f960aa None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:16.801892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-b4d94063-3b55-4db6-b2d4-c72ea7f960aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:16.859436 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81f78-37bd-4237-984b-a52ae184a36e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.870665 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 254/501] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:16.871474 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d94063-3b55-4db6-b2d4-c72ea7f960aa None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.892150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d058d58-6dd3-4d12-bc90-261aa19a04f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.893024 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058d58-6dd3-4d12-bc90-261aa19a04f2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.893024 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058d58-6dd3-4d12-bc90-261aa19a04f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.893289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058d58-6dd3-4d12-bc90-261aa19a04f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.900729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d058d58-6dd3-4d12-bc90-261aa19a04f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.902320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d058d58-6dd3-4d12-bc90-261aa19a04f2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-9d058d58-6dd3-4d12-bc90-261aa19a04f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:16.914670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:16.915797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 248/502] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:16.916989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d058d58-6dd3-4d12-bc90-261aa19a04f2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.940025 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.952326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.992380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d94063-3b55-4db6-b2d4-c72ea7f960aa None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.030823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7871a26-a646-4dad-9a71-6213cad5b32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7871a26-a646-4dad-9a71-6213cad5b32c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.031719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7871a26-a646-4dad-9a71-6213cad5b32c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.031985 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7871a26-a646-4dad-9a71-6213cad5b32c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.032532 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d058d58-6dd3-4d12-bc90-261aa19a04f2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.042902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7871a26-a646-4dad-9a71-6213cad5b32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-c7871a26-a646-4dad-9a71-6213cad5b32c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:17.047778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:17.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 255/503] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:17.053402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7871a26-a646-4dad-9a71-6213cad5b32c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.075168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885fbf9-97d8-43d7-8e82-dc507656e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.075800 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885fbf9-97d8-43d7-8e82-dc507656e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.076424 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885fbf9-97d8-43d7-8e82-dc507656e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.076424 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885fbf9-97d8-43d7-8e82-dc507656e5c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.087128 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885fbf9-97d8-43d7-8e82-dc507656e5c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.088745 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885fbf9-97d8-43d7-8e82-dc507656e5c2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e885fbf9-97d8-43d7-8e82-dc507656e5c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:17.104789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:17.105933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:17.107029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:17.107029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:17.107029 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:17.112153 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 249/504] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:17.112153 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885fbf9-97d8-43d7-8e82-dc507656e5c2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.164909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7871a26-a646-4dad-9a71-6213cad5b32c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.175272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.190192 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.199972 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943004e6-d1ec-44c0-8cff-a5882d7b425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.200585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943004e6-d1ec-44c0-8cff-a5882d7b425c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.200857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943004e6-d1ec-44c0-8cff-a5882d7b425c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.201123 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943004e6-d1ec-44c0-8cff-a5882d7b425c None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.201825 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943004e6-d1ec-44c0-8cff-a5882d7b425c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:17.202116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943004e6-d1ec-44c0-8cff-a5882d7b425c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.203525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943004e6-d1ec-44c0-8cff-a5882d7b425c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.209346 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885fbf9-97d8-43d7-8e82-dc507656e5c2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.238617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 256/505] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:17.239460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943004e6-d1ec-44c0-8cff-a5882d7b425c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.244652 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ca493-e636-45f8-b686-6978023a2e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.245245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ca493-e636-45f8-b686-6978023a2e9f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.245520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ca493-e636-45f8-b686-6978023a2e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.245789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ca493-e636-45f8-b686-6978023a2e9f None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.246511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ca493-e636-45f8-b686-6978023a2e9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:17.246809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ca493-e636-45f8-b686-6978023a2e9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.248306 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ca493-e636-45f8-b686-6978023a2e9f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.285684 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 250/506] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:17.286683 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ca493-e636-45f8-b686-6978023a2e9f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.345108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943004e6-d1ec-44c0-8cff-a5882d7b425c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.378521 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e6949-64b6-4705-a455-1b0e8485c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.379111 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e6949-64b6-4705-a455-1b0e8485c656 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.379398 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e6949-64b6-4705-a455-1b0e8485c656 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.379668 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e6949-64b6-4705-a455-1b0e8485c656 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.380378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e6949-64b6-4705-a455-1b0e8485c656 None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:17.380683 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e6949-64b6-4705-a455-1b0e8485c656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.382440 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e6949-64b6-4705-a455-1b0e8485c656 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.384551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ca493-e636-45f8-b686-6978023a2e9f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.390201 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 257/507] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:17.391050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e6949-64b6-4705-a455-1b0e8485c656 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.420163 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.422254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ec34-26f8-4d7e-8448-de8ef48d7d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.422895 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ec34-26f8-4d7e-8448-de8ef48d7d8c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.423169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ec34-26f8-4d7e-8448-de8ef48d7d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.423434 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ec34-26f8-4d7e-8448-de8ef48d7d8c None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.424087 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0ec34-26f8-4d7e-8448-de8ef48d7d8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:17.424389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0ec34-26f8-4d7e-8448-de8ef48d7d8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.426410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0ec34-26f8-4d7e-8448-de8ef48d7d8c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.432889 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.438284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 251/508] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:17.439068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ec34-26f8-4d7e-8448-de8ef48d7d8c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.495560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e6949-64b6-4705-a455-1b0e8485c656 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.531056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca4331-2d57-47a0-8bce-dc02fd147051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.531688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca4331-2d57-47a0-8bce-dc02fd147051 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.531967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca4331-2d57-47a0-8bce-dc02fd147051 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.532242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca4331-2d57-47a0-8bce-dc02fd147051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.538508 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ec34-26f8-4d7e-8448-de8ef48d7d8c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.543495 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca4331-2d57-47a0-8bce-dc02fd147051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.544987 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca4331-2d57-47a0-8bce-dc02fd147051 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-39ca4331-2d57-47a0-8bce-dc02fd147051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:17.559253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:17.560239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:17.561102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:17.561102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:17.561102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:17.561102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 258/509] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:17.561102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca4331-2d57-47a0-8bce-dc02fd147051 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.572287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585171c-1027-4fef-91fe-fbc72b6680b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.572895 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585171c-1027-4fef-91fe-fbc72b6680b4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.573165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585171c-1027-4fef-91fe-fbc72b6680b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.573428 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585171c-1027-4fef-91fe-fbc72b6680b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.636498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.639997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585171c-1027-4fef-91fe-fbc72b6680b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.641262 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.641959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585171c-1027-4fef-91fe-fbc72b6680b4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.660340 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca4331-2d57-47a0-8bce-dc02fd147051 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.694160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99438c44-3244-4128-b86d-ad547e78b24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.694762 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99438c44-3244-4128-b86d-ad547e78b24e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.695027 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99438c44-3244-4128-b86d-ad547e78b24e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.695301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99438c44-3244-4128-b86d-ad547e78b24e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.737135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 252/510] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:17.738155 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585171c-1027-4fef-91fe-fbc72b6680b4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.765536 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99438c44-3244-4128-b86d-ad547e78b24e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.767003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99438c44-3244-4128-b86d-ad547e78b24e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.836126 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.840020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585171c-1027-4fef-91fe-fbc72b6680b4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.849688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.869736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 259/511] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:17.870657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99438c44-3244-4128-b86d-ad547e78b24e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.874961 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcf437-7698-4ea2-9b87-b093cd2a2e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.875654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf437-7698-4ea2-9b87-b093cd2a2e6c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.875969 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf437-7698-4ea2-9b87-b093cd2a2e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.876280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf437-7698-4ea2-9b87-b093cd2a2e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.887047 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcf437-7698-4ea2-9b87-b093cd2a2e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.888650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcf437-7698-4ea2-9b87-b093cd2a2e6c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-57dcf437-7698-4ea2-9b87-b093cd2a2e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:17.902982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:17.903928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:17.905057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:17.905057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:17.905057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:17.905057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 253/512] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:17.905057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcf437-7698-4ea2-9b87-b093cd2a2e6c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.972699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99438c44-3244-4128-b86d-ad547e78b24e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.003491 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcf437-7698-4ea2-9b87-b093cd2a2e6c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.006498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a60e0-dbcf-463b-8142-36afa937aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.007431 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a60e0-dbcf-463b-8142-36afa937aa01 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.007702 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a60e0-dbcf-463b-8142-36afa937aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.007966 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a60e0-dbcf-463b-8142-36afa937aa01 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.014873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a60e0-dbcf-463b-8142-36afa937aa01 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.016433 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a60e0-dbcf-463b-8142-36afa937aa01 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-be5a60e0-dbcf-463b-8142-36afa937aa01 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:18.027769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:18.028941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 260/513] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:18.029873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a60e0-dbcf-463b-8142-36afa937aa01 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:18.040103 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ce2e2-ac78-464b-99ca-3590bef5d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.040743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ce2e2-ac78-464b-99ca-3590bef5d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.041010 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ce2e2-ac78-464b-99ca-3590bef5d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.041269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ce2e2-ac78-464b-99ca-3590bef5d9b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.041897 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ce2e2-ac78-464b-99ca-3590bef5d9b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:18.042188 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ce2e2-ac78-464b-99ca-3590bef5d9b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.043597 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ce2e2-ac78-464b-99ca-3590bef5d9b9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.055309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 254/514] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:18.056087 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ce2e2-ac78-464b-99ca-3590bef5d9b9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:18.069261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:18.073074 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:18.131778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a60e0-dbcf-463b-8142-36afa937aa01 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.155279 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ce2e2-ac78-464b-99ca-3590bef5d9b9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.165089 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c44109-31a5-4e23-ab54-727b25e93e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.165711 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c44109-31a5-4e23-ab54-727b25e93e5c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.165976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c44109-31a5-4e23-ab54-727b25e93e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.166234 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c44109-31a5-4e23-ab54-727b25e93e5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.176580 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c44109-31a5-4e23-ab54-727b25e93e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.178059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c44109-31a5-4e23-ab54-727b25e93e5c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.187594 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3218-67e5-4dfa-8337-936423ff60d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.188261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3218-67e5-4dfa-8337-936423ff60d9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.188531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3218-67e5-4dfa-8337-936423ff60d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.188781 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3218-67e5-4dfa-8337-936423ff60d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-15c44109-31a5-4e23-ab54-727b25e93e5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:18.191690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:18.192619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:18.193482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:18.193482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:18.193482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:18.193482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 261/515] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:18.193697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c44109-31a5-4e23-ab54-727b25e93e5c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:18.199743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f3218-67e5-4dfa-8337-936423ff60d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.201222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f3218-67e5-4dfa-8337-936423ff60d9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-8c0f3218-67e5-4dfa-8337-936423ff60d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:18.215636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:18.216785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:18.217676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:18.217676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:18.217676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:18.217676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 255/516] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:18.217676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3218-67e5-4dfa-8337-936423ff60d9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:18.282212 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:18.288785 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:18.295731 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c44109-31a5-4e23-ab54-727b25e93e5c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.321019 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3218-67e5-4dfa-8337-936423ff60d9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.327658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77fb5b-d7da-468c-893f-d59d25477367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.328364 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fb5b-d7da-468c-893f-d59d25477367 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.328677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fb5b-d7da-468c-893f-d59d25477367 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.329011 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fb5b-d7da-468c-893f-d59d25477367 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.329639 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77fb5b-d7da-468c-893f-d59d25477367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:18.329937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77fb5b-d7da-468c-893f-d59d25477367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.331311 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77fb5b-d7da-468c-893f-d59d25477367 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.343329 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 262/517] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:18.344353 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77fb5b-d7da-468c-893f-d59d25477367 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:18.356529 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70627bd8-aa02-45c3-a555-502c58ed5e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.357128 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70627bd8-aa02-45c3-a555-502c58ed5e82 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.357398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70627bd8-aa02-45c3-a555-502c58ed5e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.357660 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70627bd8-aa02-45c3-a555-502c58ed5e82 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.358370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70627bd8-aa02-45c3-a555-502c58ed5e82 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:18.358667 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70627bd8-aa02-45c3-a555-502c58ed5e82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.360327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70627bd8-aa02-45c3-a555-502c58ed5e82 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.377184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 256/518] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Oct 9 00:43:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:18.378013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70627bd8-aa02-45c3-a555-502c58ed5e82 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:18.442467 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77fb5b-d7da-468c-893f-d59d25477367 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.475854 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbbfc-0ec3-420d-94d3-bd5c1e532398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.476468 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbbfc-0ec3-420d-94d3-bd5c1e532398 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.476732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbbfc-0ec3-420d-94d3-bd5c1e532398 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.476991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbbfc-0ec3-420d-94d3-bd5c1e532398 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.477624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbbbfc-0ec3-420d-94d3-bd5c1e532398 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.479048 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbbbfc-0ec3-420d-94d3-bd5c1e532398 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.479144 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70627bd8-aa02-45c3-a555-502c58ed5e82 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.499097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:18.516071 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 263/519] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:43:18 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:18.516071 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbbfc-0ec3-420d-94d3-bd5c1e532398 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:18.516362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d00c6f-5786-4143-8c88-8205138fd7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.516362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00c6f-5786-4143-8c88-8205138fd7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.516362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00c6f-5786-4143-8c88-8205138fd7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.516362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d00c6f-5786-4143-8c88-8205138fd7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.516705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:18.516789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d00c6f-5786-4143-8c88-8205138fd7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:18.516789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d00c6f-5786-4143-8c88-8205138fd7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.518340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d00c6f-5786-4143-8c88-8205138fd7c3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.531113 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 257/520] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:18.531113 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d00c6f-5786-4143-8c88-8205138fd7c3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:18.626806 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbbfc-0ec3-420d-94d3-bd5c1e532398 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.640745 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d00c6f-5786-4143-8c88-8205138fd7c3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.666307 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee68609-3c16-4ba8-9a3a-e620582bfc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.666923 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee68609-3c16-4ba8-9a3a-e620582bfc7e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.667192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee68609-3c16-4ba8-9a3a-e620582bfc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.667457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee68609-3c16-4ba8-9a3a-e620582bfc7e None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.668115 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee68609-3c16-4ba8-9a3a-e620582bfc7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:18.668411 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee68609-3c16-4ba8-9a3a-e620582bfc7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.669768 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee68609-3c16-4ba8-9a3a-e620582bfc7e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d920f29-3da5-4cd3-85c3-dfd4a4fa0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.678969 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d920f29-3da5-4cd3-85c3-dfd4a4fa0d23 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.679241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d920f29-3da5-4cd3-85c3-dfd4a4fa0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.679502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d920f29-3da5-4cd3-85c3-dfd4a4fa0d23 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.685217 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 264/521] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:18.685466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee68609-3c16-4ba8-9a3a-e620582bfc7e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:18.688490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d920f29-3da5-4cd3-85c3-dfd4a4fa0d23 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.690236 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d920f29-3da5-4cd3-85c3-dfd4a4fa0d23 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-1d920f29-3da5-4cd3-85c3-dfd4a4fa0d23 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:18.704321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:18.705282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 258/522] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:18.706220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d920f29-3da5-4cd3-85c3-dfd4a4fa0d23 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:18.751861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:18.773362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:18.807830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee68609-3c16-4ba8-9a3a-e620582bfc7e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.819463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d920f29-3da5-4cd3-85c3-dfd4a4fa0d23 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:18.842524 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1b29e-b7fb-43c9-baf5-b3cc2860fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.843221 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1b29e-b7fb-43c9-baf5-b3cc2860fe8b None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.843496 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1b29e-b7fb-43c9-baf5-b3cc2860fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.843763 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1b29e-b7fb-43c9-baf5-b3cc2860fe8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.854177 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6961a9-050d-4794-bd90-fcf7b078c9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:18.854805 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6961a9-050d-4794-bd90-fcf7b078c9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.855072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6961a9-050d-4794-bd90-fcf7b078c9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.855335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6961a9-050d-4794-bd90-fcf7b078c9c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.862197 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6961a9-050d-4794-bd90-fcf7b078c9c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.863656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6961a9-050d-4794-bd90-fcf7b078c9c5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-db6961a9-050d-4794-bd90-fcf7b078c9c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:18.875857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:18.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:18.883379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:18.883379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:18.883379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:18.883379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:18.883379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:18.883379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:18.883379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:18.883379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:18.883379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 259/523] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:18.883379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6961a9-050d-4794-bd90-fcf7b078c9c5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:18.922919 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1b29e-b7fb-43c9-baf5-b3cc2860fe8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:18.924765 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1b29e-b7fb-43c9-baf5-b3cc2860fe8b None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:18.980907 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:18.983764 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6961a9-050d-4794-bd90-fcf7b078c9c5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.000496 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:19.023524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653b2e5-8b1c-42d7-b63a-169d6fb2d70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.024241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653b2e5-8b1c-42d7-b63a-169d6fb2d70a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.024497 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653b2e5-8b1c-42d7-b63a-169d6fb2d70a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653b2e5-8b1c-42d7-b63a-169d6fb2d70a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.032351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653b2e5-8b1c-42d7-b63a-169d6fb2d70a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.033963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653b2e5-8b1c-42d7-b63a-169d6fb2d70a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.039975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 265/524] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:19.039975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1b29e-b7fb-43c9-baf5-b3cc2860fe8b None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e653b2e5-8b1c-42d7-b63a-169d6fb2d70a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:19.045512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:19.046709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:19.048380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:19.048380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:19.048380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:19.048380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:19.048380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:19.048380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:19.048380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:19.048380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:19.048380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 260/525] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:19.048380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653b2e5-8b1c-42d7-b63a-169d6fb2d70a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.150295 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653b2e5-8b1c-42d7-b63a-169d6fb2d70a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.156897 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1b29e-b7fb-43c9-baf5-b3cc2860fe8b None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.191095 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e086de-ac91-4084-8d86-c34601370bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.191710 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e086de-ac91-4084-8d86-c34601370bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.191987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e086de-ac91-4084-8d86-c34601370bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.192280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e086de-ac91-4084-8d86-c34601370bc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.192836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729bdf4-9a98-4c7f-94d8-9d556be5b7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.193323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e086de-ac91-4084-8d86-c34601370bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:19.193690 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e086de-ac91-4084-8d86-c34601370bc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.193777 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729bdf4-9a98-4c7f-94d8-9d556be5b7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.194153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729bdf4-9a98-4c7f-94d8-9d556be5b7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.194511 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729bdf4-9a98-4c7f-94d8-9d556be5b7d3 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.195132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e086de-ac91-4084-8d86-c34601370bc0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.195425 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729bdf4-9a98-4c7f-94d8-9d556be5b7d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:19.195815 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729bdf4-9a98-4c7f-94d8-9d556be5b7d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.197539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729bdf4-9a98-4c7f-94d8-9d556be5b7d3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.213614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 261/526] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:19.214429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e086de-ac91-4084-8d86-c34601370bc0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.226047 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 266/527] 10.222.0.43 () {56 vars in 1139 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:19.226047 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729bdf4-9a98-4c7f-94d8-9d556be5b7d3 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.237845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:19.257621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:19.320403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e086de-ac91-4084-8d86-c34601370bc0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.336115 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729bdf4-9a98-4c7f-94d8-9d556be5b7d3 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.363568 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d683d04-4b67-4e27-b2ae-ca6e9890a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.364381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d683d04-4b67-4e27-b2ae-ca6e9890a4ad None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.364774 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d683d04-4b67-4e27-b2ae-ca6e9890a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.365239 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d683d04-4b67-4e27-b2ae-ca6e9890a4ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.371244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f80700-9101-43dc-ac33-15989ed67925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.372332 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f80700-9101-43dc-ac33-15989ed67925 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.372669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f80700-9101-43dc-ac33-15989ed67925 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.372996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f80700-9101-43dc-ac33-15989ed67925 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.374114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f80700-9101-43dc-ac33-15989ed67925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:19.374611 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f80700-9101-43dc-ac33-15989ed67925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.375233 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d683d04-4b67-4e27-b2ae-ca6e9890a4ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.376186 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f80700-9101-43dc-ac33-15989ed67925 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.376731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d683d04-4b67-4e27-b2ae-ca6e9890a4ad None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-2d683d04-4b67-4e27-b2ae-ca6e9890a4ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:19.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:19.393157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:19.394831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:19.394831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:19.394831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:19.394831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 262/528] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:19.394831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d683d04-4b67-4e27-b2ae-ca6e9890a4ad None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.400796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 267/529] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:19.402124 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f80700-9101-43dc-ac33-15989ed67925 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.471984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:19.498904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:19.506175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d683d04-4b67-4e27-b2ae-ca6e9890a4ad None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.516912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f80700-9101-43dc-ac33-15989ed67925 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.543193 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec272048-d5ee-42ed-8812-3668673385a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.543988 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272048-d5ee-42ed-8812-3668673385a5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.544295 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272048-d5ee-42ed-8812-3668673385a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.544571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272048-d5ee-42ed-8812-3668673385a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.545431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec272048-d5ee-42ed-8812-3668673385a5 None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=dbbd529122d64e46a70f62e351b27fd1) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:19.545946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec272048-d5ee-42ed-8812-3668673385a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.547783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec272048-d5ee-42ed-8812-3668673385a5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.551774 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a26c09-3b88-4e88-a777-0b9dd5ff158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.552739 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a26c09-3b88-4e88-a777-0b9dd5ff158a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.552988 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a26c09-3b88-4e88-a777-0b9dd5ff158a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.553264 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a26c09-3b88-4e88-a777-0b9dd5ff158a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.553419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 263/530] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/role_assignments?user.id=dbbd529122d64e46a70f62e351b27fd1&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:19.565186 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec272048-d5ee-42ed-8812-3668673385a5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.641719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a26c09-3b88-4e88-a777-0b9dd5ff158a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.643341 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a26c09-3b88-4e88-a777-0b9dd5ff158a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.697990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec272048-d5ee-42ed-8812-3668673385a5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.743265 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd185c-bc13-482b-99e0-04287c869362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.743995 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd185c-bc13-482b-99e0-04287c869362 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.744351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd185c-bc13-482b-99e0-04287c869362 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.744458 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:19.744793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd185c-bc13-482b-99e0-04287c869362 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.745522 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd185c-bc13-482b-99e0-04287c869362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:19.745893 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd185c-bc13-482b-99e0-04287c869362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.747179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd185c-bc13-482b-99e0-04287c869362 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.750092 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:19.759822 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 268/531] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:19.760881 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a26c09-3b88-4e88-a777-0b9dd5ff158a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.771651 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 264/532] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:19.772828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd185c-bc13-482b-99e0-04287c869362 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.873093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a26c09-3b88-4e88-a777-0b9dd5ff158a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.908333 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd185c-bc13-482b-99e0-04287c869362 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.911656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dd662-220c-435c-a6c1-4307fbba5656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.912914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dd662-220c-435c-a6c1-4307fbba5656 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.913191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dd662-220c-435c-a6c1-4307fbba5656 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.913502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dd662-220c-435c-a6c1-4307fbba5656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.914227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dd662-220c-435c-a6c1-4307fbba5656 None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=f960fdabbffa4813a0ea46bb82218f09) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:19.914528 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dd662-220c-435c-a6c1-4307fbba5656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.915977 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dd662-220c-435c-a6c1-4307fbba5656 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.924532 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 269/533] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/role_assignments?user.id=f960fdabbffa4813a0ea46bb82218f09&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:19.925435 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dd662-220c-435c-a6c1-4307fbba5656 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.986684 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e54a59-1339-4eb6-90f1-47a87700c611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.987396 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54a59-1339-4eb6-90f1-47a87700c611 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.987673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54a59-1339-4eb6-90f1-47a87700c611 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.987940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54a59-1339-4eb6-90f1-47a87700c611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.010051 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.010553 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e54a59-1339-4eb6-90f1-47a87700c611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.012102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e54a59-1339-4eb6-90f1-47a87700c611 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-72e54a59-1339-4eb6-90f1-47a87700c611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:20.041110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:20.042117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:20.043039 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:20.043039 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:20.043039 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:20.043039 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 265/534] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:20.049316 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e54a59-1339-4eb6-90f1-47a87700c611 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.086277 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dd662-220c-435c-a6c1-4307fbba5656 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.124370 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb0525-ea82-4cf0-a60a-e58797fcb22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.125002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb0525-ea82-4cf0-a60a-e58797fcb22b None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.125272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb0525-ea82-4cf0-a60a-e58797fcb22b None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.126794 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb0525-ea82-4cf0-a60a-e58797fcb22b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.135550 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb0525-ea82-4cf0-a60a-e58797fcb22b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.137516 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb0525-ea82-4cf0-a60a-e58797fcb22b None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.148515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-f7fb0525-ea82-4cf0-a60a-e58797fcb22b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:20.154292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:20.155318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:20.156437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:20.156437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:20.156437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:20.156437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:20.156437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:20.156437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:20.156437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:20.156437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:20.156952 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 270/535] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:20.165181 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb0525-ea82-4cf0-a60a-e58797fcb22b None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.216494 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e54a59-1339-4eb6-90f1-47a87700c611 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.276193 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1470e-3dbb-4624-a757-46d4991b5798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.278648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1470e-3dbb-4624-a757-46d4991b5798 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.279113 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1470e-3dbb-4624-a757-46d4991b5798 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.279755 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1470e-3dbb-4624-a757-46d4991b5798 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.281450 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1470e-3dbb-4624-a757-46d4991b5798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:20.282304 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1470e-3dbb-4624-a757-46d4991b5798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.288344 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1470e-3dbb-4624-a757-46d4991b5798 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.300902 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 266/536] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:20.313197 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1470e-3dbb-4624-a757-46d4991b5798 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.316992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb0525-ea82-4cf0-a60a-e58797fcb22b None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.330752 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.353618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975881c1-7fd3-4477-907a-738c89b034a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.354528 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975881c1-7fd3-4477-907a-738c89b034a7 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.354937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975881c1-7fd3-4477-907a-738c89b034a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.355338 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975881c1-7fd3-4477-907a-738c89b034a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.356179 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975881c1-7fd3-4477-907a-738c89b034a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:20.356638 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975881c1-7fd3-4477-907a-738c89b034a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975881c1-7fd3-4477-907a-738c89b034a7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.371729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 271/537] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:20.380228 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975881c1-7fd3-4477-907a-738c89b034a7 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.456014 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1470e-3dbb-4624-a757-46d4991b5798 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.466019 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.515713 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bf3f9-98ad-4fac-92d3-e1b688a3a5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.517427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bf3f9-98ad-4fac-92d3-e1b688a3a5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.518037 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bf3f9-98ad-4fac-92d3-e1b688a3a5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.519650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bf3f9-98ad-4fac-92d3-e1b688a3a5d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.532066 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bf3f9-98ad-4fac-92d3-e1b688a3a5d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.533943 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bf3f9-98ad-4fac-92d3-e1b688a3a5d0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-503bf3f9-98ad-4fac-92d3-e1b688a3a5d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:20.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:20.552648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:20.553726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:20.553726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:20.553726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:20.553726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:20.553726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:20.553726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:20.553726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:20.553726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:20.555723 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 267/538] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:20.561688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bf3f9-98ad-4fac-92d3-e1b688a3a5d0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.618140 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975881c1-7fd3-4477-907a-738c89b034a7 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.702323 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760834-6904-47de-b445-2f49847a4186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.702946 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760834-6904-47de-b445-2f49847a4186 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.703220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760834-6904-47de-b445-2f49847a4186 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.703486 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760834-6904-47de-b445-2f49847a4186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.704231 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f760834-6904-47de-b445-2f49847a4186 None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=a44cd61c1bfd4ed29e7ede8f8e3a22be) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:20.704538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f760834-6904-47de-b445-2f49847a4186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.705969 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f760834-6904-47de-b445-2f49847a4186 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.720098 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bf3f9-98ad-4fac-92d3-e1b688a3a5d0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.720759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 272/539] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/role_assignments?user.id=a44cd61c1bfd4ed29e7ede8f8e3a22be&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 259 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:20.782383 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e961c-2e92-4819-94ae-f71185dcdbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.783266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e961c-2e92-4819-94ae-f71185dcdbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.783687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e961c-2e92-4819-94ae-f71185dcdbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.784204 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e961c-2e92-4819-94ae-f71185dcdbe8 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.785033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e961c-2e92-4819-94ae-f71185dcdbe8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:20.785478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e961c-2e92-4819-94ae-f71185dcdbe8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.787279 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e961c-2e92-4819-94ae-f71185dcdbe8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.806334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 268/540] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:20.813198 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760834-6904-47de-b445-2f49847a4186 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.852620 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f030c14-e70e-4a87-b38a-e6871db412ba None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.852912 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f030c14-e70e-4a87-b38a-e6871db412ba None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.853292 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f030c14-e70e-4a87-b38a-e6871db412ba None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.854668 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 269/541] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:20.864630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c77a96-f3c2-44c8-a5cd-b25b72cd91b0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c77a96-f3c2-44c8-a5cd-b25b72cd91b0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.865176 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c77a96-f3c2-44c8-a5cd-b25b72cd91b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.874812 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.897153 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-71c77a96-f3c2-44c8-a5cd-b25b72cd91b0 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:20.898383 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-71c77a96-f3c2-44c8-a5cd-b25b72cd91b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:20.945985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.972402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760834-6904-47de-b445-2f49847a4186 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.027688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 270/542] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:43:21.034040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b54ba-2ce9-4046-8fbf-48b633dd3ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.034846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b54ba-2ce9-4046-8fbf-48b633dd3ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.035265 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b54ba-2ce9-4046-8fbf-48b633dd3ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.035672 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b54ba-2ce9-4046-8fbf-48b633dd3ff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.036708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b54ba-2ce9-4046-8fbf-48b633dd3ff2 None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=a33cbccb6a374b5f941fd4b768ff6766) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:21.037175 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b54ba-2ce9-4046-8fbf-48b633dd3ff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.038803 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b54ba-2ce9-4046-8fbf-48b633dd3ff2 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.045956 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 273/543] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/role_assignments?user.id=a33cbccb6a374b5f941fd4b768ff6766&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:21.355706 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c77a96-f3c2-44c8-a5cd-b25b72cd91b0 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:21.467131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c77a96-f3c2-44c8-a5cd-b25b72cd91b0 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.501055 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cc7a8-4716-475b-ba5e-2a041897d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.501687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cc7a8-4716-475b-ba5e-2a041897d91f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.501956 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cc7a8-4716-475b-ba5e-2a041897d91f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.502218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cc7a8-4716-475b-ba5e-2a041897d91f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.513350 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cc7a8-4716-475b-ba5e-2a041897d91f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-876cc7a8-4716-475b-ba5e-2a041897d91f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:21.518107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:21.519015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:21.519854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 271/544] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:21.525523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b54ba-2ce9-4046-8fbf-48b633dd3ff2 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:21.626198 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:21.629231 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b54ba-2ce9-4046-8fbf-48b633dd3ff2 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.662995 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dc701-5759-431b-8d26-0a27d0ecd638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.663599 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dc701-5759-431b-8d26-0a27d0ecd638 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.663867 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dc701-5759-431b-8d26-0a27d0ecd638 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.664156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dc701-5759-431b-8d26-0a27d0ecd638 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.664807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dc701-5759-431b-8d26-0a27d0ecd638 None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:21.665100 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dc701-5759-431b-8d26-0a27d0ecd638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.666454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dc701-5759-431b-8d26-0a27d0ecd638 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.675104 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 274/545] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:21.680783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cc7a8-4716-475b-ba5e-2a041897d91f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:21.704415 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:21.813652 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cc7a8-4716-475b-ba5e-2a041897d91f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.854559 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9e84f-574b-4898-972e-b912aa9a893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.855195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e84f-574b-4898-972e-b912aa9a893f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.855466 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e84f-574b-4898-972e-b912aa9a893f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.855728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e84f-574b-4898-972e-b912aa9a893f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.870228 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9e84f-574b-4898-972e-b912aa9a893f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.871728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9e84f-574b-4898-972e-b912aa9a893f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-48a9e84f-574b-4898-972e-b912aa9a893f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:21.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:21.896195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:21.897187 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:21.897187 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:21.897187 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:21.897187 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 272/546] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:21.902071 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dc701-5759-431b-8d26-0a27d0ecd638 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:22.004053 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dc701-5759-431b-8d26-0a27d0ecd638 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:22.026040 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64623b6c-3438-4b0b-9838-698481a84054 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.026370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64623b6c-3438-4b0b-9838-698481a84054 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.026572 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64623b6c-3438-4b0b-9838-698481a84054 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.028427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 273/547] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:22.037520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c1946-f2a3-434c-a516-c2f6d1e2949d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.037916 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c1946-f2a3-434c-a516-c2f6d1e2949d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.038354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c1946-f2a3-434c-a516-c2f6d1e2949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.049035 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58d08f-2430-4750-8bb6-a3ff3a2b1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:22.049661 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58d08f-2430-4750-8bb6-a3ff3a2b1741 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.049939 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58d08f-2430-4750-8bb6-a3ff3a2b1741 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.050206 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58d08f-2430-4750-8bb6-a3ff3a2b1741 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.050846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58d08f-2430-4750-8bb6-a3ff3a2b1741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:22.051144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58d08f-2430-4750-8bb6-a3ff3a2b1741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:22.052706 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58d08f-2430-4750-8bb6-a3ff3a2b1741 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:22.059925 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-c99c1946-f2a3-434c-a516-c2f6d1e2949d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:22.061872 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c99c1946-f2a3-434c-a516-c2f6d1e2949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:22.081156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 275/548] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:22.086311 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58d08f-2430-4750-8bb6-a3ff3a2b1741 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:22.135925 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:22.188710 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:22.191145 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 274/549] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:22.237909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58d08f-2430-4750-8bb6-a3ff3a2b1741 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:22.288275 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5f8d-b97d-4137-ab5c-fa2898a43752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:22.288912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5f8d-b97d-4137-ab5c-fa2898a43752 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.289188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5f8d-b97d-4137-ab5c-fa2898a43752 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.289458 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5f8d-b97d-4137-ab5c-fa2898a43752 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.298021 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5f8d-b97d-4137-ab5c-fa2898a43752 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:22.299469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5f8d-b97d-4137-ab5c-fa2898a43752 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-f04d5f8d-b97d-4137-ab5c-fa2898a43752 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:22.314968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:22.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:22.318402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:22.318402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:22.318402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:22.318402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:22.318402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:22.318402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:22.318402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:22.318402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:22.318402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:22.318402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:22.318402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 276/550] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:22.321982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c1946-f2a3-434c-a516-c2f6d1e2949d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:22.429377 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c1946-f2a3-434c-a516-c2f6d1e2949d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:22.468362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e90679-5b02-485e-bfff-713ac69dd906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:22.468988 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e90679-5b02-485e-bfff-713ac69dd906 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.469268 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e90679-5b02-485e-bfff-713ac69dd906 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.469540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e90679-5b02-485e-bfff-713ac69dd906 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.470267 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e90679-5b02-485e-bfff-713ac69dd906 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:22.470570 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e90679-5b02-485e-bfff-713ac69dd906 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:22.472209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e90679-5b02-485e-bfff-713ac69dd906 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:22.493063 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 275/551] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Oct 9 00:43:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:22.501188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5f8d-b97d-4137-ab5c-fa2898a43752 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:22.503005 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e90679-5b02-485e-bfff-713ac69dd906 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:22.572480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:22.615202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e90679-5b02-485e-bfff-713ac69dd906 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:22.622238 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:22.641211 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5f8d-b97d-4137-ab5c-fa2898a43752 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:22.653020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4712e-c0cd-4fc3-9c83-ad9651bb01fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:22.653678 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4712e-c0cd-4fc3-9c83-ad9651bb01fd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.653961 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4712e-c0cd-4fc3-9c83-ad9651bb01fd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.654232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4712e-c0cd-4fc3-9c83-ad9651bb01fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.665658 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4712e-c0cd-4fc3-9c83-ad9651bb01fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-38e4712e-c0cd-4fc3-9c83-ad9651bb01fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:22.670524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:22.672401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:22.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 276/552] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:22.674003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b172e6-5757-43a2-b2a4-80a39b4d74d1 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.674003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b172e6-5757-43a2-b2a4-80a39b4d74d1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.674003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b172e6-5757-43a2-b2a4-80a39b4d74d1 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.675309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 277/553] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:22.685283 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fe55b-7b0b-4b35-8bce-b3ea41276477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:22.685892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fe55b-7b0b-4b35-8bce-b3ea41276477 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.686167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fe55b-7b0b-4b35-8bce-b3ea41276477 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.686437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fe55b-7b0b-4b35-8bce-b3ea41276477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.687277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b64f40-eb16-468c-9af4-af89a3b9dbbd None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.687945 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b64f40-eb16-468c-9af4-af89a3b9dbbd None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.688465 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b64f40-eb16-468c-9af4-af89a3b9dbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.712424 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b8b64f40-eb16-468c-9af4-af89a3b9dbbd None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:22.714006 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b8b64f40-eb16-468c-9af4-af89a3b9dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:22.757485 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fe55b-7b0b-4b35-8bce-b3ea41276477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:22.758951 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fe55b-7b0b-4b35-8bce-b3ea41276477 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:22.805442 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 278/554] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:22.806755 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b64f40-eb16-468c-9af4-af89a3b9dbbd None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:22.865318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:22.875569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:22.913942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 277/555] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:22.916095 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b64f40-eb16-468c-9af4-af89a3b9dbbd None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:22.919649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fe55b-7b0b-4b35-8bce-b3ea41276477 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:22.953323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98f47a-0193-43dd-aa29-d49d010888a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:22.954516 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98f47a-0193-43dd-aa29-d49d010888a3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.955026 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98f47a-0193-43dd-aa29-d49d010888a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.955494 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98f47a-0193-43dd-aa29-d49d010888a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.956390 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98f47a-0193-43dd-aa29-d49d010888a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:22.956932 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98f47a-0193-43dd-aa29-d49d010888a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:22.958752 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98f47a-0193-43dd-aa29-d49d010888a3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:22.972096 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 279/556] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:22.973718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98f47a-0193-43dd-aa29-d49d010888a3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:23.042600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fe55b-7b0b-4b35-8bce-b3ea41276477 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:23.077692 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b3b0a-c19f-40f6-88e0-c324da627d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:23.078197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3b0a-c19f-40f6-88e0-c324da627d80 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.078467 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3b0a-c19f-40f6-88e0-c324da627d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.078732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3b0a-c19f-40f6-88e0-c324da627d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.089479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b3b0a-c19f-40f6-88e0-c324da627d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:23.090928 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b3b0a-c19f-40f6-88e0-c324da627d80 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:23.105896 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98f47a-0193-43dd-aa29-d49d010888a3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-cb3b3b0a-c19f-40f6-88e0-c324da627d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:23.114428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:23.115560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:23.117150 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:23.117150 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:23.117150 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:23.117150 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 278/557] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:23.120492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:23.121682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b3b0a-c19f-40f6-88e0-c324da627d80 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:23.147273 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a403d-9886-469f-a19b-fb38dc113973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:23.148450 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a403d-9886-469f-a19b-fb38dc113973 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.148939 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a403d-9886-469f-a19b-fb38dc113973 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.149402 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a403d-9886-469f-a19b-fb38dc113973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.172230 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a403d-9886-469f-a19b-fb38dc113973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:23.173704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a403d-9886-469f-a19b-fb38dc113973 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-962a403d-9886-469f-a19b-fb38dc113973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:23.198861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:23.200796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:23.201943 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:23.201943 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:23.201943 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:23.201943 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 280/558] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:23.209365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a403d-9886-469f-a19b-fb38dc113973 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:23.212853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:23.294873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b3b0a-c19f-40f6-88e0-c324da627d80 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:23.330168 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60709cc7-3b87-4968-bf83-9c699413fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:23.330769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60709cc7-3b87-4968-bf83-9c699413fe9d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.331047 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60709cc7-3b87-4968-bf83-9c699413fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.332702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a403d-9886-469f-a19b-fb38dc113973 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:23.332816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60709cc7-3b87-4968-bf83-9c699413fe9d None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.332816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60709cc7-3b87-4968-bf83-9c699413fe9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:23.332816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60709cc7-3b87-4968-bf83-9c699413fe9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:23.333815 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60709cc7-3b87-4968-bf83-9c699413fe9d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:23.347026 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 279/559] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:23.347445 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60709cc7-3b87-4968-bf83-9c699413fe9d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:23.376069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d72485-ad48-4038-832b-5f9211504ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:23.376069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d72485-ad48-4038-832b-5f9211504ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.376069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d72485-ad48-4038-832b-5f9211504ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.376069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d72485-ad48-4038-832b-5f9211504ce1 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.376513 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d72485-ad48-4038-832b-5f9211504ce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:23.376513 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d72485-ad48-4038-832b-5f9211504ce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:23.377676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d72485-ad48-4038-832b-5f9211504ce1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:23.393296 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 281/560] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:23.394404 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d72485-ad48-4038-832b-5f9211504ce1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:23.425097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:23.446595 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:23.454964 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60709cc7-3b87-4968-bf83-9c699413fe9d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:23.499424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e0aff-0b67-43c7-9692-067db947b479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:23.500402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e0aff-0b67-43c7-9692-067db947b479 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.500677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e0aff-0b67-43c7-9692-067db947b479 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.500950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e0aff-0b67-43c7-9692-067db947b479 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.517443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e0aff-0b67-43c7-9692-067db947b479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:23.522686 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d72485-ad48-4038-832b-5f9211504ce1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-fa8e0aff-0b67-43c7-9692-067db947b479 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:23.523305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:23.524263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:23.525149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:23.528112 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 280/561] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:23.529110 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e0aff-0b67-43c7-9692-067db947b479 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:23.572513 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cac170-7802-4b8d-8b82-d99254262dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:23.573062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cac170-7802-4b8d-8b82-d99254262dba None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.573336 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cac170-7802-4b8d-8b82-d99254262dba None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.573601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cac170-7802-4b8d-8b82-d99254262dba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.583570 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cac170-7802-4b8d-8b82-d99254262dba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:23.586121 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cac170-7802-4b8d-8b82-d99254262dba None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-c2cac170-7802-4b8d-8b82-d99254262dba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:23.603756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:23.604770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:23.605711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:23.605711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:23.605711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:23.605711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:23.605711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:23.605711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:23.605711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:23.605711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:23.605711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 282/562] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:23.606318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cac170-7802-4b8d-8b82-d99254262dba None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:23.643356 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e0aff-0b67-43c7-9692-067db947b479 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:23.682091 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e65d5b-49c7-4097-81b8-9cee048841a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:23.682893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e65d5b-49c7-4097-81b8-9cee048841a3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.683290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e65d5b-49c7-4097-81b8-9cee048841a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.683631 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e65d5b-49c7-4097-81b8-9cee048841a3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.691739 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e65d5b-49c7-4097-81b8-9cee048841a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:23.693382 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e65d5b-49c7-4097-81b8-9cee048841a3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:23.699468 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-c9e65d5b-49c7-4097-81b8-9cee048841a3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:23.706388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:23.707608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:23.709258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:23.709258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:23.709258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:23.709258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:23.709258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:23.709258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:23.709258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:23.709258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:23.709258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:43:23.709258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:23.714248 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 281/563] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:23.715535 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627a07-a403-4e3b-89c6-cb6b714df24b None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.715814 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627a07-a403-4e3b-89c6-cb6b714df24b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.716104 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627a07-a403-4e3b-89c6-cb6b714df24b None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.721398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cac170-7802-4b8d-8b82-d99254262dba None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:23.721785 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 282/564] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:23.722443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3627a07-a403-4e3b-89c6-cb6b714df24b None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:23.738961 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:23.757587 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1343b0-32ad-48d7-835b-9fbdc564a56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:23.758208 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1343b0-32ad-48d7-835b-9fbdc564a56e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.758477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1343b0-32ad-48d7-835b-9fbdc564a56e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.758752 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1343b0-32ad-48d7-835b-9fbdc564a56e None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.759410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1343b0-32ad-48d7-835b-9fbdc564a56e None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:23.759723 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1343b0-32ad-48d7-835b-9fbdc564a56e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:23.761141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1343b0-32ad-48d7-835b-9fbdc564a56e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:23.773770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 283/565] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:23.773770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1343b0-32ad-48d7-835b-9fbdc564a56e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:23.830666 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3627a07-a403-4e3b-89c6-cb6b714df24b None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:23.864467 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34e5e1-a6fb-48ad-9b69-34299ed7b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:23.865076 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34e5e1-a6fb-48ad-9b69-34299ed7b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.865337 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34e5e1-a6fb-48ad-9b69-34299ed7b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.865601 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34e5e1-a6fb-48ad-9b69-34299ed7b7b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.866270 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34e5e1-a6fb-48ad-9b69-34299ed7b7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:23.866566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34e5e1-a6fb-48ad-9b69-34299ed7b7b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:23.867988 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34e5e1-a6fb-48ad-9b69-34299ed7b7b5 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:23.869806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1343b0-32ad-48d7-835b-9fbdc564a56e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:23.881439 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 283/566] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:23.883528 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ade1-64ce-4c3c-ac3a-392eb0c95ccd None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.883954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ade1-64ce-4c3c-ac3a-392eb0c95ccd None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.884370 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ade1-64ce-4c3c-ac3a-392eb0c95ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.904663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-77f9ade1-64ce-4c3c-ac3a-392eb0c95ccd None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:23.905855 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-77f9ade1-64ce-4c3c-ac3a-392eb0c95ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:23.908394 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0e3c8-1b1f-4d22-84f8-6f1ecad074bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:23.908999 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0e3c8-1b1f-4d22-84f8-6f1ecad074bb None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.909273 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0e3c8-1b1f-4d22-84f8-6f1ecad074bb None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.909543 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0e3c8-1b1f-4d22-84f8-6f1ecad074bb None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.910262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0e3c8-1b1f-4d22-84f8-6f1ecad074bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:23.910558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0e3c8-1b1f-4d22-84f8-6f1ecad074bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:23.912213 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0e3c8-1b1f-4d22-84f8-6f1ecad074bb None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:23.929653 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 284/567] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Oct 9 00:43:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:23.930977 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c2691-e53f-4e6e-b807-cd2ed2957efb None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.931261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c2691-e53f-4e6e-b807-cd2ed2957efb None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.931530 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c2691-e53f-4e6e-b807-cd2ed2957efb None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.932968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 285/568] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:23.933611 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c2691-e53f-4e6e-b807-cd2ed2957efb None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:23.936666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:23.980342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 284/569] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:23.981176 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ade1-64ce-4c3c-ac3a-392eb0c95ccd None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:23.984530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.035769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c2691-e53f-4e6e-b807-cd2ed2957efb None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.068343 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6199d3-963c-4653-b374-36115c730f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.069232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6199d3-963c-4653-b374-36115c730f95 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.069486 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6199d3-963c-4653-b374-36115c730f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.069745 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6199d3-963c-4653-b374-36115c730f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.079946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6199d3-963c-4653-b374-36115c730f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.081481 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6199d3-963c-4653-b374-36115c730f95 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.088481 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ade1-64ce-4c3c-ac3a-392eb0c95ccd None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-1c6199d3-963c-4653-b374-36115c730f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:24.096179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:24.097165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:24.098090 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:24.098090 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:24.098090 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:24.101994 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 286/570] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:24.102712 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6199d3-963c-4653-b374-36115c730f95 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.127001 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cf7b0-45a2-46ef-9ef6-c3e185d90fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.127632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cf7b0-45a2-46ef-9ef6-c3e185d90fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.127892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cf7b0-45a2-46ef-9ef6-c3e185d90fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.128190 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cf7b0-45a2-46ef-9ef6-c3e185d90fb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.128905 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cf7b0-45a2-46ef-9ef6-c3e185d90fb8 None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=cbc22a3976aa47cfb4367b0a433742ea) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:24.129539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cf7b0-45a2-46ef-9ef6-c3e185d90fb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.131083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cf7b0-45a2-46ef-9ef6-c3e185d90fb8 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.144071 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 285/571] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:23 2022] GET /identity/v3/role_assignments?user.id=cbc22a3976aa47cfb4367b0a433742ea&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:24.144071 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e88983-5f39-412e-9038-089c54a8b02f None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.144071 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e88983-5f39-412e-9038-089c54a8b02f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.144071 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e88983-5f39-412e-9038-089c54a8b02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.165771 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-66e88983-5f39-412e-9038-089c54a8b02f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:24.166978 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-66e88983-5f39-412e-9038-089c54a8b02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:24.169600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.237205 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6199d3-963c-4653-b374-36115c730f95 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.246167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.254188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 286/572] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:24.255893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e88983-5f39-412e-9038-089c54a8b02f None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.285999 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9deaf-420f-4596-8b2d-1e75235981d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.286885 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9deaf-420f-4596-8b2d-1e75235981d9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.287254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9deaf-420f-4596-8b2d-1e75235981d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.287644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9deaf-420f-4596-8b2d-1e75235981d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.299589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9deaf-420f-4596-8b2d-1e75235981d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.301300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9deaf-420f-4596-8b2d-1e75235981d9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-aba9deaf-420f-4596-8b2d-1e75235981d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:24.317385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:24.318918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:24.319854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:24.319854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:24.319854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:24.323437 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 287/573] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:24.324408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9deaf-420f-4596-8b2d-1e75235981d9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.371741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e88983-5f39-412e-9038-089c54a8b02f None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.410911 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795384a-6c23-4bb2-bbe4-7f88564d1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.411983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795384a-6c23-4bb2-bbe4-7f88564d1518 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.412317 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795384a-6c23-4bb2-bbe4-7f88564d1518 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.412561 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795384a-6c23-4bb2-bbe4-7f88564d1518 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.413471 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795384a-6c23-4bb2-bbe4-7f88564d1518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:24.413771 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795384a-6c23-4bb2-bbe4-7f88564d1518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.415587 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795384a-6c23-4bb2-bbe4-7f88564d1518 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.435842 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 287/574] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:24.437236 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795384a-6c23-4bb2-bbe4-7f88564d1518 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.438018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9deaf-420f-4596-8b2d-1e75235981d9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.452414 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.485733 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da10b7e-ac08-4728-b40e-a4de1f209c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.486368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da10b7e-ac08-4728-b40e-a4de1f209c80 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.486646 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da10b7e-ac08-4728-b40e-a4de1f209c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.486914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da10b7e-ac08-4728-b40e-a4de1f209c80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.500997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da10b7e-ac08-4728-b40e-a4de1f209c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-9da10b7e-ac08-4728-b40e-a4de1f209c80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:24.508694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:24.509721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:24.510623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:24.511314 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.512031 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 288/575] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:24.513547 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da10b7e-ac08-4728-b40e-a4de1f209c80 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.560525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795384a-6c23-4bb2-bbe4-7f88564d1518 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.594846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f525c54-5b09-457e-b82c-69910b3ca5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.595487 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f525c54-5b09-457e-b82c-69910b3ca5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.595763 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f525c54-5b09-457e-b82c-69910b3ca5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.596030 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f525c54-5b09-457e-b82c-69910b3ca5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.596692 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f525c54-5b09-457e-b82c-69910b3ca5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:24.596989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f525c54-5b09-457e-b82c-69910b3ca5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.598356 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f525c54-5b09-457e-b82c-69910b3ca5a0 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.610367 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 288/576] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:24.611188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f525c54-5b09-457e-b82c-69910b3ca5a0 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.635044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da10b7e-ac08-4728-b40e-a4de1f209c80 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.672318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646413fd-a427-466e-925f-3f56be2ac543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.673025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646413fd-a427-466e-925f-3f56be2ac543 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.673331 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646413fd-a427-466e-925f-3f56be2ac543 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.673592 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646413fd-a427-466e-925f-3f56be2ac543 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.681926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646413fd-a427-466e-925f-3f56be2ac543 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.683388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646413fd-a427-466e-925f-3f56be2ac543 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-646413fd-a427-466e-925f-3f56be2ac543 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:24.695600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:24.696700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 289/577] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:24.697702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646413fd-a427-466e-925f-3f56be2ac543 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.722874 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f525c54-5b09-457e-b82c-69910b3ca5a0 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.726986 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.742033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.761446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06163b91-4857-41e8-91d5-24e37ab7d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.762142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06163b91-4857-41e8-91d5-24e37ab7d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.762473 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06163b91-4857-41e8-91d5-24e37ab7d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.762793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06163b91-4857-41e8-91d5-24e37ab7d6d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.763447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06163b91-4857-41e8-91d5-24e37ab7d6d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:24.763747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06163b91-4857-41e8-91d5-24e37ab7d6d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.765160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06163b91-4857-41e8-91d5-24e37ab7d6d0 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.777837 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 289/578] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:24.778667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06163b91-4857-41e8-91d5-24e37ab7d6d0 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.820769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646413fd-a427-466e-925f-3f56be2ac543 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.862583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eca7c1-df8d-40d3-b203-e680e0f2fbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.863221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eca7c1-df8d-40d3-b203-e680e0f2fbed None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.863498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eca7c1-df8d-40d3-b203-e680e0f2fbed None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.863776 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eca7c1-df8d-40d3-b203-e680e0f2fbed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.876767 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eca7c1-df8d-40d3-b203-e680e0f2fbed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-44eca7c1-df8d-40d3-b203-e680e0f2fbed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:24.882688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:24.883847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:24.884915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:24.886912 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 290/579] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:24.887851 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eca7c1-df8d-40d3-b203-e680e0f2fbed None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.894253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06163b91-4857-41e8-91d5-24e37ab7d6d0 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.929582 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3e853-2ba3-4039-bc41-a2138f224ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.930494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3e853-2ba3-4039-bc41-a2138f224ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.930870 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3e853-2ba3-4039-bc41-a2138f224ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.931237 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3e853-2ba3-4039-bc41-a2138f224ac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.938144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3e853-2ba3-4039-bc41-a2138f224ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.939639 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3e853-2ba3-4039-bc41-a2138f224ac0 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-21d3e853-2ba3-4039-bc41-a2138f224ac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:24.951177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:24.952153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:24.953182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:24.953182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:24.953182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:24.953182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:24.953182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:24.953182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:24.953182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:24.953182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:24.953182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 290/580] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:24.953182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3e853-2ba3-4039-bc41-a2138f224ac0 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.986990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.998840 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.004633 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eca7c1-df8d-40d3-b203-e680e0f2fbed None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.042722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212ee5-5d3b-4fdf-8727-d95a06c989cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.043355 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212ee5-5d3b-4fdf-8727-d95a06c989cf None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.043794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212ee5-5d3b-4fdf-8727-d95a06c989cf None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.044097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212ee5-5d3b-4fdf-8727-d95a06c989cf None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.045308 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4212ee5-5d3b-4fdf-8727-d95a06c989cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:25.045894 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4212ee5-5d3b-4fdf-8727-d95a06c989cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.047579 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4212ee5-5d3b-4fdf-8727-d95a06c989cf None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.064864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3e853-2ba3-4039-bc41-a2138f224ac0 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.073585 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 291/581] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:25.073585 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212ee5-5d3b-4fdf-8727-d95a06c989cf None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.105326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec342d-339a-4561-9592-66a99dfc33cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.106261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec342d-339a-4561-9592-66a99dfc33cb None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.106538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec342d-339a-4561-9592-66a99dfc33cb None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.106808 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec342d-339a-4561-9592-66a99dfc33cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.118242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec342d-339a-4561-9592-66a99dfc33cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.119700 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec342d-339a-4561-9592-66a99dfc33cb None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-d7ec342d-339a-4561-9592-66a99dfc33cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:25.135390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:25.136447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:25.137539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:25.137539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:25.137539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:25.137539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 291/582] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:25.137802 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec342d-339a-4561-9592-66a99dfc33cb None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.175682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212ee5-5d3b-4fdf-8727-d95a06c989cf None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.209781 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689e85c-d0bc-465e-91c5-416c3083fd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.210381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689e85c-d0bc-465e-91c5-416c3083fd6b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.210656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689e85c-d0bc-465e-91c5-416c3083fd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.210924 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689e85c-d0bc-465e-91c5-416c3083fd6b None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.211597 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689e85c-d0bc-465e-91c5-416c3083fd6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:25.211899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689e85c-d0bc-465e-91c5-416c3083fd6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.213356 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689e85c-d0bc-465e-91c5-416c3083fd6b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.221691 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 292/583] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:25.222484 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689e85c-d0bc-465e-91c5-416c3083fd6b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.231563 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.240301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.250124 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec342d-339a-4561-9592-66a99dfc33cb None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.285340 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703b452-bd35-4b3c-980b-097a2021eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.285959 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703b452-bd35-4b3c-980b-097a2021eb71 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.286239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703b452-bd35-4b3c-980b-097a2021eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.286607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703b452-bd35-4b3c-980b-097a2021eb71 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.287290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703b452-bd35-4b3c-980b-097a2021eb71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:25.287590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703b452-bd35-4b3c-980b-097a2021eb71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.289035 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703b452-bd35-4b3c-980b-097a2021eb71 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.302222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 292/584] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:25.303333 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703b452-bd35-4b3c-980b-097a2021eb71 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.333036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689e85c-d0bc-465e-91c5-416c3083fd6b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.368015 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b513b-dea9-4605-a16e-62ddd7ac83d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.368983 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b513b-dea9-4605-a16e-62ddd7ac83d5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.369322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b513b-dea9-4605-a16e-62ddd7ac83d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.369599 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b513b-dea9-4605-a16e-62ddd7ac83d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.383838 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b513b-dea9-4605-a16e-62ddd7ac83d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.385326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b513b-dea9-4605-a16e-62ddd7ac83d5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a12b513b-dea9-4605-a16e-62ddd7ac83d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:25.400123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:25.401180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:25.402112 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:25.402112 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:25.402112 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:25.402112 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 293/585] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:25.402112 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b513b-dea9-4605-a16e-62ddd7ac83d5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.415390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703b452-bd35-4b3c-980b-097a2021eb71 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.454471 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d8d5-d630-4dfb-84d5-78d621541d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.455086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d8d5-d630-4dfb-84d5-78d621541d1f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.455358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d8d5-d630-4dfb-84d5-78d621541d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.455625 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d8d5-d630-4dfb-84d5-78d621541d1f None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.456280 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d8d5-d630-4dfb-84d5-78d621541d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:25.456578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d8d5-d630-4dfb-84d5-78d621541d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.457963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d8d5-d630-4dfb-84d5-78d621541d1f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.462906 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.476200 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 293/586] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:25.477060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d8d5-d630-4dfb-84d5-78d621541d1f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.493326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.505447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b513b-dea9-4605-a16e-62ddd7ac83d5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.543420 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672b2a9-f4ca-4e1b-8aa5-8c07751a5ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.544073 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b2a9-f4ca-4e1b-8aa5-8c07751a5ebd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.544362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b2a9-f4ca-4e1b-8aa5-8c07751a5ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.544637 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b2a9-f4ca-4e1b-8aa5-8c07751a5ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.556234 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672b2a9-f4ca-4e1b-8aa5-8c07751a5ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.557709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672b2a9-f4ca-4e1b-8aa5-8c07751a5ebd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-f672b2a9-f4ca-4e1b-8aa5-8c07751a5ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:25.572864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:25.573959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:25.575025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:25.575025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:25.575025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:25.575025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 294/587] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:25.575025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672b2a9-f4ca-4e1b-8aa5-8c07751a5ebd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.588882 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d8d5-d630-4dfb-84d5-78d621541d1f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.630242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b86941-2171-4daf-b3a5-7719391db8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.631291 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86941-2171-4daf-b3a5-7719391db8c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.631566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86941-2171-4daf-b3a5-7719391db8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.631836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86941-2171-4daf-b3a5-7719391db8c8 None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/dbbd529122d64e46a70f62e351b27fd1/roles/275b5127bdb241f1bf7690c67d80591b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.647347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b86941-2171-4daf-b3a5-7719391db8c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=dbbd529122d64e46a70f62e351b27fd1, role_id=275b5127bdb241f1bf7690c67d80591b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.649007 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b86941-2171-4daf-b3a5-7719391db8c8 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.662119 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 294/588] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:25 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/dbbd529122d64e46a70f62e351b27fd1/roles/275b5127bdb241f1bf7690c67d80591b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:25.662926 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b86941-2171-4daf-b3a5-7719391db8c8 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.697260 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672b2a9-f4ca-4e1b-8aa5-8c07751a5ebd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.714669 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.749047 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d01c18-4bd2-43b7-b5dd-328469a0d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.750124 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d01c18-4bd2-43b7-b5dd-328469a0d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.750624 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d01c18-4bd2-43b7-b5dd-328469a0d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.751022 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d01c18-4bd2-43b7-b5dd-328469a0d2d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.751788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d01c18-4bd2-43b7-b5dd-328469a0d2d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:25.752199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d01c18-4bd2-43b7-b5dd-328469a0d2d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.752939 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.755285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d01c18-4bd2-43b7-b5dd-328469a0d2d6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.774509 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 295/589] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:25.776304 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d01c18-4bd2-43b7-b5dd-328469a0d2d6 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.810416 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b86941-2171-4daf-b3a5-7719391db8c8 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.858026 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad512f-889a-473f-98f3-c40ed02da747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.858833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad512f-889a-473f-98f3-c40ed02da747 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.859207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad512f-889a-473f-98f3-c40ed02da747 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.859844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad512f-889a-473f-98f3-c40ed02da747 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.874317 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad512f-889a-473f-98f3-c40ed02da747 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.876511 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad512f-889a-473f-98f3-c40ed02da747 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-5aad512f-889a-473f-98f3-c40ed02da747 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:25.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:25.892122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 295/590] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:25.893378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad512f-889a-473f-98f3-c40ed02da747 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.908377 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d01c18-4bd2-43b7-b5dd-328469a0d2d6 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.968193 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a58c1-d3e5-4492-af49-8f1bf4801ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.968955 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a58c1-d3e5-4492-af49-8f1bf4801ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.969333 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a58c1-d3e5-4492-af49-8f1bf4801ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.969704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a58c1-d3e5-4492-af49-8f1bf4801ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.970444 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a58c1-d3e5-4492-af49-8f1bf4801ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:25.970849 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a58c1-d3e5-4492-af49-8f1bf4801ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.972367 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a58c1-d3e5-4492-af49-8f1bf4801ac5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.985420 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 296/591] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:25.991196 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a58c1-d3e5-4492-af49-8f1bf4801ac5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.024553 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.032376 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad512f-889a-473f-98f3-c40ed02da747 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.065054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.080506 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc87b96-3204-4291-b30a-54459658fe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.081691 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc87b96-3204-4291-b30a-54459658fe34 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.082583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc87b96-3204-4291-b30a-54459658fe34 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.083013 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc87b96-3204-4291-b30a-54459658fe34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.092220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc87b96-3204-4291-b30a-54459658fe34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.094682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc87b96-3204-4291-b30a-54459658fe34 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.102181 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a58c1-d3e5-4492-af49-8f1bf4801ac5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-fdc87b96-3204-4291-b30a-54459658fe34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:26.110402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:26.111522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:26.112705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:26.112705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:26.112705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:26.112705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:26.112705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:26.112705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:26.112705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:26.112705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:26.115348 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 296/592] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:26.116306 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc87b96-3204-4291-b30a-54459658fe34 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.147150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c62376-5068-4956-8eb4-ff3bb41c09f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.147855 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c62376-5068-4956-8eb4-ff3bb41c09f4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.148259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c62376-5068-4956-8eb4-ff3bb41c09f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.148631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c62376-5068-4956-8eb4-ff3bb41c09f4 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.149554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c62376-5068-4956-8eb4-ff3bb41c09f4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:26.149964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c62376-5068-4956-8eb4-ff3bb41c09f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.151640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c62376-5068-4956-8eb4-ff3bb41c09f4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.176178 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 297/593] 10.222.0.43 () {56 vars in 1139 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:26.176178 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c62376-5068-4956-8eb4-ff3bb41c09f4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.261895 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc87b96-3204-4291-b30a-54459658fe34 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.283702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.304998 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c62376-5068-4956-8eb4-ff3bb41c09f4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.306845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdbf40-e6b9-4875-8ab1-6b56b60362b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.307672 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdbf40-e6b9-4875-8ab1-6b56b60362b4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.308131 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdbf40-e6b9-4875-8ab1-6b56b60362b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.308533 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdbf40-e6b9-4875-8ab1-6b56b60362b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.316709 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdbf40-e6b9-4875-8ab1-6b56b60362b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.318700 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdbf40-e6b9-4875-8ab1-6b56b60362b4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-29fdbf40-e6b9-4875-8ab1-6b56b60362b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:26.330671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:26.331873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:26.333086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:26.333086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:26.333086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:26.333086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:26.333086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:26.333086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:26.333086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:26.333086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:26.333086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:43:26.333086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:26.339906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 297/594] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:26.340951 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdbf40-e6b9-4875-8ab1-6b56b60362b4 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.348486 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c007b-3c6f-42d4-b8f9-1bfcfc2e6612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.349454 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c007b-3c6f-42d4-b8f9-1bfcfc2e6612 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.350046 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c007b-3c6f-42d4-b8f9-1bfcfc2e6612 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.350589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c007b-3c6f-42d4-b8f9-1bfcfc2e6612 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.351387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c007b-3c6f-42d4-b8f9-1bfcfc2e6612 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:26.351799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c007b-3c6f-42d4-b8f9-1bfcfc2e6612 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.353958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c007b-3c6f-42d4-b8f9-1bfcfc2e6612 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.369078 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 298/595] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:26.369913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c007b-3c6f-42d4-b8f9-1bfcfc2e6612 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.393233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.454530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdbf40-e6b9-4875-8ab1-6b56b60362b4 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.475881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c007b-3c6f-42d4-b8f9-1bfcfc2e6612 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.490822 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b3d8d-7765-4f6b-b9da-8547ccfa4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.491456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b3d8d-7765-4f6b-b9da-8547ccfa4695 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.491733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b3d8d-7765-4f6b-b9da-8547ccfa4695 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.492002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b3d8d-7765-4f6b-b9da-8547ccfa4695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.503067 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b3d8d-7765-4f6b-b9da-8547ccfa4695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.504560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b3d8d-7765-4f6b-b9da-8547ccfa4695 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.512837 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06560c06-91db-44c5-b01a-71a8c8cd78df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.513639 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06560c06-91db-44c5-b01a-71a8c8cd78df None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.514075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06560c06-91db-44c5-b01a-71a8c8cd78df None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.514488 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06560c06-91db-44c5-b01a-71a8c8cd78df None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.515347 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06560c06-91db-44c5-b01a-71a8c8cd78df None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:26.515810 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06560c06-91db-44c5-b01a-71a8c8cd78df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.517433 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06560c06-91db-44c5-b01a-71a8c8cd78df None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-7a0b3d8d-7765-4f6b-b9da-8547ccfa4695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:26.519389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:26.520534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:26.521586 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:26.521586 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:26.521586 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:26.521586 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 298/596] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:26.521828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73791281-4827-48b2-a738-c4f2fcf42df4 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.522041 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73791281-4827-48b2-a738-c4f2fcf42df4 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.522314 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73791281-4827-48b2-a738-c4f2fcf42df4 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.523700 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 299/597] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:26.528276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73791281-4827-48b2-a738-c4f2fcf42df4 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.546234 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 299/598] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:26.546234 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06560c06-91db-44c5-b01a-71a8c8cd78df None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.555532 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.629459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.640119 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73791281-4827-48b2-a738-c4f2fcf42df4 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.656146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06560c06-91db-44c5-b01a-71a8c8cd78df None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.680961 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2811a12-1833-4426-8d06-e5d4a4663c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.681937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811a12-1833-4426-8d06-e5d4a4663c59 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.682358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811a12-1833-4426-8d06-e5d4a4663c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.682772 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811a12-1833-4426-8d06-e5d4a4663c59 None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/f960fdabbffa4813a0ea46bb82218f09/roles/275b5127bdb241f1bf7690c67d80591b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.693061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85202439-6d03-47cf-b49d-38d5fb48a432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.693674 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202439-6d03-47cf-b49d-38d5fb48a432 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.693953 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202439-6d03-47cf-b49d-38d5fb48a432 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.694278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85202439-6d03-47cf-b49d-38d5fb48a432 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.694971 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85202439-6d03-47cf-b49d-38d5fb48a432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:26.695478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85202439-6d03-47cf-b49d-38d5fb48a432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.697751 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85202439-6d03-47cf-b49d-38d5fb48a432 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.699481 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2811a12-1833-4426-8d06-e5d4a4663c59 None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=f960fdabbffa4813a0ea46bb82218f09, role_id=275b5127bdb241f1bf7690c67d80591b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.701472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2811a12-1833-4426-8d06-e5d4a4663c59 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.711799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 300/599] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:26.713270 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91e78-bc4b-4577-bd45-5e0d935dcfcd None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.713552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91e78-bc4b-4577-bd45-5e0d935dcfcd None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.713821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf91e78-bc4b-4577-bd45-5e0d935dcfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.728121 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 300/600] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:26 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/f960fdabbffa4813a0ea46bb82218f09/roles/275b5127bdb241f1bf7690c67d80591b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:26.728121 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2811a12-1833-4426-8d06-e5d4a4663c59 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.745412 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2bf91e78-bc4b-4577-bd45-5e0d935dcfcd None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:26.747837 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2bf91e78-bc4b-4577-bd45-5e0d935dcfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:26.841201 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.847430 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 301/601] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:26.853635 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf91e78-bc4b-4577-bd45-5e0d935dcfcd None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.869846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2811a12-1833-4426-8d06-e5d4a4663c59 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.945786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85736065-8ba9-479b-ba11-c18a68be476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.946680 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85736065-8ba9-479b-ba11-c18a68be476d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.947103 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85736065-8ba9-479b-ba11-c18a68be476d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.947514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85736065-8ba9-479b-ba11-c18a68be476d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.959283 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85736065-8ba9-479b-ba11-c18a68be476d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.964074 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85736065-8ba9-479b-ba11-c18a68be476d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.974019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-85736065-8ba9-479b-ba11-c18a68be476d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:26.981864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:26.982872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:26.983831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:26.983831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:26.983831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:26.984835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 301/602] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:26.989833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85736065-8ba9-479b-ba11-c18a68be476d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:27.056340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf91e78-bc4b-4577-bd45-5e0d935dcfcd None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:27.127252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85736065-8ba9-479b-ba11-c18a68be476d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:27.133735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d22276-223f-420b-a347-5e65eb6b0563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:27.134669 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d22276-223f-420b-a347-5e65eb6b0563 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.135148 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d22276-223f-420b-a347-5e65eb6b0563 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.135614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d22276-223f-420b-a347-5e65eb6b0563 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.152342 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d22276-223f-420b-a347-5e65eb6b0563 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:27.154132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d22276-223f-420b-a347-5e65eb6b0563 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-56d22276-223f-420b-a347-5e65eb6b0563 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:27.167132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:27.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:27.169044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:27.169044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:27.169044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:27.169044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:27.169044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:27.169044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:27.169044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:27.169044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:27.170667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f18f9-de9e-4a19-9229-d76c647af451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:27.171328 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f18f9-de9e-4a19-9229-d76c647af451 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.171663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f18f9-de9e-4a19-9229-d76c647af451 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.171873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f18f9-de9e-4a19-9229-d76c647af451 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.176423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f18f9-de9e-4a19-9229-d76c647af451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:27.176423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f18f9-de9e-4a19-9229-d76c647af451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:27.176423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f18f9-de9e-4a19-9229-d76c647af451 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:27.177160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 302/603] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:27.178223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d22276-223f-420b-a347-5e65eb6b0563 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:27.189132 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 302/604] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:27.190079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f18f9-de9e-4a19-9229-d76c647af451 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:27.243012 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:27.252886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:27.293049 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d22276-223f-420b-a347-5e65eb6b0563 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:27.300342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f18f9-de9e-4a19-9229-d76c647af451 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:27.330066 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c14309-da4c-4d39-92b3-d5753bd9437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:27.331139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c14309-da4c-4d39-92b3-d5753bd9437f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.331560 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c14309-da4c-4d39-92b3-d5753bd9437f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.332024 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c14309-da4c-4d39-92b3-d5753bd9437f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.336504 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44afcc-f407-4f45-bcf4-373e41110dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:27.337118 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44afcc-f407-4f45-bcf4-373e41110dca None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.337396 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44afcc-f407-4f45-bcf4-373e41110dca None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.337664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44afcc-f407-4f45-bcf4-373e41110dca None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.338642 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44afcc-f407-4f45-bcf4-373e41110dca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:27.338948 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44afcc-f407-4f45-bcf4-373e41110dca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:27.340409 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44afcc-f407-4f45-bcf4-373e41110dca None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:27.344809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c14309-da4c-4d39-92b3-d5753bd9437f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e1c14309-da4c-4d39-92b3-d5753bd9437f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:27.350700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:27.351818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:27.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:27.353509 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 303/605] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:27.353753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44afcc-f407-4f45-bcf4-373e41110dca None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:27.360322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 303/606] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:27.361427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c14309-da4c-4d39-92b3-d5753bd9437f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:27.469119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c14309-da4c-4d39-92b3-d5753bd9437f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:27.479764 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44afcc-f407-4f45-bcf4-373e41110dca None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:27.486899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:27.501636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:27.507645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031866f-e67b-4fb5-be58-ad20d43888ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:27.508654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031866f-e67b-4fb5-be58-ad20d43888ec None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.509136 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031866f-e67b-4fb5-be58-ad20d43888ec None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.509621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031866f-e67b-4fb5-be58-ad20d43888ec None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/a33cbccb6a374b5f941fd4b768ff6766/roles/275b5127bdb241f1bf7690c67d80591b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.522221 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3b10d-f86d-47e6-9295-89908644e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:27.523112 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3b10d-f86d-47e6-9295-89908644e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.523387 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3b10d-f86d-47e6-9295-89908644e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.523654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3b10d-f86d-47e6-9295-89908644e0f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.527303 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031866f-e67b-4fb5-be58-ad20d43888ec None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=a33cbccb6a374b5f941fd4b768ff6766, role_id=275b5127bdb241f1bf7690c67d80591b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:27.529023 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031866f-e67b-4fb5-be58-ad20d43888ec None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:27.531455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3b10d-f86d-47e6-9295-89908644e0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:27.533226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3b10d-f86d-47e6-9295-89908644e0f9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-bbe3b10d-f86d-47e6-9295-89908644e0f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:27.546869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:27.548063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:27.549084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:27.549084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:27.549084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:27.549084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:27.549084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:27.549084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:27.549084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:27.549084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:27.552199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 304/608] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:27 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/a33cbccb6a374b5f941fd4b768ff6766/roles/275b5127bdb241f1bf7690c67d80591b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:27.553407 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 304/608] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:27.553651 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031866f-e67b-4fb5-be58-ad20d43888ec None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:27.554596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3b10d-f86d-47e6-9295-89908644e0f9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:27.676321 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3b10d-f86d-47e6-9295-89908644e0f9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:27.714850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9cb82-8a30-4e87-8576-e9db0e237baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:27.715844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cb82-8a30-4e87-8576-e9db0e237baa None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.716367 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cb82-8a30-4e87-8576-e9db0e237baa None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.716834 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cb82-8a30-4e87-8576-e9db0e237baa None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.717777 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9cb82-8a30-4e87-8576-e9db0e237baa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:27.718283 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9cb82-8a30-4e87-8576-e9db0e237baa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:27.719977 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9cb82-8a30-4e87-8576-e9db0e237baa None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:27.734775 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 305/609] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:27.741147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9cb82-8a30-4e87-8576-e9db0e237baa None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:27.779457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:27.786473 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031866f-e67b-4fb5-be58-ad20d43888ec None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:27.858571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c391d6-9372-421d-9604-3405b60b5c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:27.859198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c391d6-9372-421d-9604-3405b60b5c4c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.859474 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c391d6-9372-421d-9604-3405b60b5c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.859748 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c391d6-9372-421d-9604-3405b60b5c4c None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.860454 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c391d6-9372-421d-9604-3405b60b5c4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:27.860755 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c391d6-9372-421d-9604-3405b60b5c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:27.862143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c391d6-9372-421d-9604-3405b60b5c4c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:27.877144 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 305/610] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:27.884168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c391d6-9372-421d-9604-3405b60b5c4c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:27.911932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9cb82-8a30-4e87-8576-e9db0e237baa None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:27.945919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:27.966744 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89081ee-f950-4681-8a0f-91dfebc184d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:27.967813 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89081ee-f950-4681-8a0f-91dfebc184d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.968112 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89081ee-f950-4681-8a0f-91dfebc184d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.968645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89081ee-f950-4681-8a0f-91dfebc184d7 None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/a44cd61c1bfd4ed29e7ede8f8e3a22be/roles/275b5127bdb241f1bf7690c67d80591b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.987744 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89081ee-f950-4681-8a0f-91dfebc184d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=a44cd61c1bfd4ed29e7ede8f8e3a22be, role_id=275b5127bdb241f1bf7690c67d80591b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:27.989644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89081ee-f950-4681-8a0f-91dfebc184d7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:28.007653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 306/611] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:27 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/a44cd61c1bfd4ed29e7ede8f8e3a22be/roles/275b5127bdb241f1bf7690c67d80591b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:28.009407 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39147f27-8eac-4a88-b30c-692daa801ded None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.009738 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39147f27-8eac-4a88-b30c-692daa801ded None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.010009 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39147f27-8eac-4a88-b30c-692daa801ded None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.016696 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 307/612] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:28.018837 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8bd23-9bac-478a-b64a-395e399e368d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.019274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8bd23-9bac-478a-b64a-395e399e368d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.019662 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8bd23-9bac-478a-b64a-395e399e368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.039506 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c391d6-9372-421d-9604-3405b60b5c4c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:28.044217 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-93a8bd23-9bac-478a-b64a-395e399e368d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:28.045445 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-93a8bd23-9bac-478a-b64a-395e399e368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:28.132956 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355699-bf96-4a18-b194-632035efad23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:28.133894 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355699-bf96-4a18-b194-632035efad23 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.134174 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355699-bf96-4a18-b194-632035efad23 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.134536 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355699-bf96-4a18-b194-632035efad23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.137163 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 308/613] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:28.165368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7355699-bf96-4a18-b194-632035efad23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:28.166865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7355699-bf96-4a18-b194-632035efad23 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b7355699-bf96-4a18-b194-632035efad23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:28.186240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:28.187278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:28.188388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:28.188388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:28.188388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:28.192289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 306/614] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:28.193738 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8bd23-9bac-478a-b64a-395e399e368d None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:28.212502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:28.323879 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8bd23-9bac-478a-b64a-395e399e368d None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:28.359860 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9be2e-665b-4d82-a7c2-0cab31ed672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:28.360264 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9be2e-665b-4d82-a7c2-0cab31ed672d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.364083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9be2e-665b-4d82-a7c2-0cab31ed672d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.364083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9be2e-665b-4d82-a7c2-0cab31ed672d None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.364083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9be2e-665b-4d82-a7c2-0cab31ed672d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:28.364083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9be2e-665b-4d82-a7c2-0cab31ed672d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:28.364083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9be2e-665b-4d82-a7c2-0cab31ed672d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:28.376324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 309/615] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:28.383939 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355699-bf96-4a18-b194-632035efad23 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:28.476872 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:28.497946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355699-bf96-4a18-b194-632035efad23 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:28.540812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eec9c6-858f-41de-a0fb-aaae28ac7cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:28.541521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eec9c6-858f-41de-a0fb-aaae28ac7cdc None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.541798 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eec9c6-858f-41de-a0fb-aaae28ac7cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.542070 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eec9c6-858f-41de-a0fb-aaae28ac7cdc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.551865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eec9c6-858f-41de-a0fb-aaae28ac7cdc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:28.557503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eec9c6-858f-41de-a0fb-aaae28ac7cdc None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:28.568097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9be2e-665b-4d82-a7c2-0cab31ed672d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-f1eec9c6-858f-41de-a0fb-aaae28ac7cdc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:28.581410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:28.582502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:28.583672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:28.583672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:28.583672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:28.583672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:28.583672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:28.583672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:28.583672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:28.583672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:28.583672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:28.583672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:28.589602 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 307/616] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:28.592218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eec9c6-858f-41de-a0fb-aaae28ac7cdc None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:28.740223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:28.796070 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9be2e-665b-4d82-a7c2-0cab31ed672d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:28.819801 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eec9c6-858f-41de-a0fb-aaae28ac7cdc None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:28.862667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee9fbd-fa51-4540-99d8-3116bc86b2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:28.863320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee9fbd-fa51-4540-99d8-3116bc86b2ca None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.863640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee9fbd-fa51-4540-99d8-3116bc86b2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.863910 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee9fbd-fa51-4540-99d8-3116bc86b2ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.904690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee9fbd-fa51-4540-99d8-3116bc86b2ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:28.905034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b040d-68b7-4e07-ad1c-faa8be9cf299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:28.905596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b040d-68b7-4e07-ad1c-faa8be9cf299 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.905875 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b040d-68b7-4e07-ad1c-faa8be9cf299 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.912063 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b040d-68b7-4e07-ad1c-faa8be9cf299 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.912063 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b040d-68b7-4e07-ad1c-faa8be9cf299 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:28.912063 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b040d-68b7-4e07-ad1c-faa8be9cf299 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-d3ee9fbd-fa51-4540-99d8-3116bc86b2ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:28.912355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:28.913584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:28.914446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 310/617] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:28.920424 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b040d-68b7-4e07-ad1c-faa8be9cf299 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:28.920642 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee9fbd-fa51-4540-99d8-3116bc86b2ca None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:28.948076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:28.968069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 308/618] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Oct 9 00:43:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:28.972064 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b040d-68b7-4e07-ad1c-faa8be9cf299 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:29.218406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee9fbd-fa51-4540-99d8-3116bc86b2ca None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:29.267878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b040d-68b7-4e07-ad1c-faa8be9cf299 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:29.268332 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5995945-53d9-41bb-9b4d-8b8da212440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:29.268908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995945-53d9-41bb-9b4d-8b8da212440f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.269186 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995945-53d9-41bb-9b4d-8b8da212440f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.269461 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995945-53d9-41bb-9b4d-8b8da212440f None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.270138 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5995945-53d9-41bb-9b4d-8b8da212440f None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:29.270440 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5995945-53d9-41bb-9b4d-8b8da212440f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:29.276099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5995945-53d9-41bb-9b4d-8b8da212440f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:29.276099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:29.289509 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 311/619] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:29.290937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5995945-53d9-41bb-9b4d-8b8da212440f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:29.381747 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2b00b-8b6e-430d-a81f-77e002b117c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:29.383108 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2b00b-8b6e-430d-a81f-77e002b117c8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.383591 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2b00b-8b6e-430d-a81f-77e002b117c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.384087 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2b00b-8b6e-430d-a81f-77e002b117c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.403295 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5995945-53d9-41bb-9b4d-8b8da212440f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:29.406045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2b00b-8b6e-430d-a81f-77e002b117c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:29.407729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2b00b-8b6e-430d-a81f-77e002b117c8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-91d2b00b-8b6e-430d-a81f-77e002b117c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:29.423736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:29.424806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:29.425751 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:29.425751 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:29.425751 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:29.428275 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 309/620] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 460 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:29.429701 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4ad8d-3eb2-45d6-9074-9a587ffe36e3 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.430218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4ad8d-3eb2-45d6-9074-9a587ffe36e3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.430706 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4ad8d-3eb2-45d6-9074-9a587ffe36e3 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.436760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 310/621] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:29.438393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce2a3d-14a2-43e0-abb8-ed35b027d8b9 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.438904 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce2a3d-14a2-43e0-abb8-ed35b027d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.439394 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce2a3d-14a2-43e0-abb8-ed35b027d8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.445258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa963a-e52b-4574-8c3c-da771d7754b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:29.445903 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa963a-e52b-4574-8c3c-da771d7754b6 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.446784 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa963a-e52b-4574-8c3c-da771d7754b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.447051 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa963a-e52b-4574-8c3c-da771d7754b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.458392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa963a-e52b-4574-8c3c-da771d7754b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:29.459949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa963a-e52b-4574-8c3c-da771d7754b6 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:29.460753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-e5ce2a3d-14a2-43e0-abb8-ed35b027d8b9 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:29.462166 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e5ce2a3d-14a2-43e0-abb8-ed35b027d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-a6aa963a-e52b-4574-8c3c-da771d7754b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:29.474660 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:29.475654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:29.476624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:29.476624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:29.476624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:29.480408 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 312/622] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:29.481296 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa963a-e52b-4574-8c3c-da771d7754b6 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:29.516887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:29.535365 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:29.540467 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 311/623] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:29.549109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce2a3d-14a2-43e0-abb8-ed35b027d8b9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:29.590993 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa963a-e52b-4574-8c3c-da771d7754b6 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:29.626452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982ede-c93b-4c4d-8182-634ee955f8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:29.627341 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982ede-c93b-4c4d-8182-634ee955f8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.627772 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982ede-c93b-4c4d-8182-634ee955f8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.628222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982ede-c93b-4c4d-8182-634ee955f8f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.629022 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982ede-c93b-4c4d-8182-634ee955f8f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:29.629464 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982ede-c93b-4c4d-8182-634ee955f8f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:29.631254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982ede-c93b-4c4d-8182-634ee955f8f9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:29.649369 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 313/624] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:29.651062 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982ede-c93b-4c4d-8182-634ee955f8f9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:29.656700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce2a3d-14a2-43e0-abb8-ed35b027d8b9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:29.693744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fa937-9da1-472b-9bc8-a97482b90f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:29.694516 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fa937-9da1-472b-9bc8-a97482b90f2a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.695057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fa937-9da1-472b-9bc8-a97482b90f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.695270 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fa937-9da1-472b-9bc8-a97482b90f2a None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.696010 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fa937-9da1-472b-9bc8-a97482b90f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:29.696441 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fa937-9da1-472b-9bc8-a97482b90f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:29.697942 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fa937-9da1-472b-9bc8-a97482b90f2a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:29.714915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 312/625] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:29.729198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fa937-9da1-472b-9bc8-a97482b90f2a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:29.772220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982ede-c93b-4c4d-8182-634ee955f8f9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:29.783895 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:29.810500 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc13e4-2fb5-4103-b6b7-025255d79529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:29.810724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:29.811831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc13e4-2fb5-4103-b6b7-025255d79529 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.812409 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc13e4-2fb5-4103-b6b7-025255d79529 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.812975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc13e4-2fb5-4103-b6b7-025255d79529 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.821324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc13e4-2fb5-4103-b6b7-025255d79529 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:29.823116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc13e4-2fb5-4103-b6b7-025255d79529 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-5cbc13e4-2fb5-4103-b6b7-025255d79529 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:29.835167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:29.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:29.837502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:29.837502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:29.837502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:29.837502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:29.837502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:29.837502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:29.837502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:29.837502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:29.843867 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 314/626] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:29.845462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc13e4-2fb5-4103-b6b7-025255d79529 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:29.885141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fa937-9da1-472b-9bc8-a97482b90f2a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:29.934852 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e606d1a-53d4-484d-a178-c046c2c5c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:29.935792 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606d1a-53d4-484d-a178-c046c2c5c343 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.936249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606d1a-53d4-484d-a178-c046c2c5c343 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.936711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606d1a-53d4-484d-a178-c046c2c5c343 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.945056 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e606d1a-53d4-484d-a178-c046c2c5c343 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:29.946777 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e606d1a-53d4-484d-a178-c046c2c5c343 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-4e606d1a-53d4-484d-a178-c046c2c5c343 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:29.958836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:29.959990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:29.961127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:29.961127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:29.961127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:29.961127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:29.961127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:29.961127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:29.961127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:29.961127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:29.961127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:43:29.961127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:29.967607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc13e4-2fb5-4103-b6b7-025255d79529 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:29.968279 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 313/627] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:29.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e606d1a-53d4-484d-a178-c046c2c5c343 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.004350 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22937cb6-ca40-4e7b-b9fb-3e29349e6577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.005414 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22937cb6-ca40-4e7b-b9fb-3e29349e6577 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.005869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22937cb6-ca40-4e7b-b9fb-3e29349e6577 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.006146 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22937cb6-ca40-4e7b-b9fb-3e29349e6577 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.007429 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22937cb6-ca40-4e7b-b9fb-3e29349e6577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:30.007733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22937cb6-ca40-4e7b-b9fb-3e29349e6577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.009514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22937cb6-ca40-4e7b-b9fb-3e29349e6577 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.027336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 315/628] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:30.027336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22937cb6-ca40-4e7b-b9fb-3e29349e6577 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.060613 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:30.090863 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:30.095856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e606d1a-53d4-484d-a178-c046c2c5c343 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.136423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7359437-2995-48ce-a1e9-24dd3c2c990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.137056 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7359437-2995-48ce-a1e9-24dd3c2c990c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.137330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7359437-2995-48ce-a1e9-24dd3c2c990c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.137602 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7359437-2995-48ce-a1e9-24dd3c2c990c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.139021 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22937cb6-ca40-4e7b-b9fb-3e29349e6577 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.149330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7359437-2995-48ce-a1e9-24dd3c2c990c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-c7359437-2995-48ce-a1e9-24dd3c2c990c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:30.155072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:30.156258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 314/629] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:30.157288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7359437-2995-48ce-a1e9-24dd3c2c990c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.177908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968d67-20fc-4832-b093-ee73a0d01927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.178820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968d67-20fc-4832-b093-ee73a0d01927 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.179254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968d67-20fc-4832-b093-ee73a0d01927 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.179679 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968d67-20fc-4832-b093-ee73a0d01927 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.180587 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968d67-20fc-4832-b093-ee73a0d01927 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:30.181209 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968d67-20fc-4832-b093-ee73a0d01927 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.182868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968d67-20fc-4832-b093-ee73a0d01927 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.201866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 316/630] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:30.202769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968d67-20fc-4832-b093-ee73a0d01927 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.270306 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7359437-2995-48ce-a1e9-24dd3c2c990c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.303756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:30.307654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb140d-1243-4534-ac62-57cc7dec3b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.308676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb140d-1243-4534-ac62-57cc7dec3b55 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.308948 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb140d-1243-4534-ac62-57cc7dec3b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.309217 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb140d-1243-4534-ac62-57cc7dec3b55 None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/cbc22a3976aa47cfb4367b0a433742ea/roles/275b5127bdb241f1bf7690c67d80591b` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.317384 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968d67-20fc-4832-b093-ee73a0d01927 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.326777 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb140d-1243-4534-ac62-57cc7dec3b55 None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=cbc22a3976aa47cfb4367b0a433742ea, role_id=275b5127bdb241f1bf7690c67d80591b)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.328646 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb140d-1243-4534-ac62-57cc7dec3b55 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.344011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 315/631] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:30 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/cbc22a3976aa47cfb4367b0a433742ea/roles/275b5127bdb241f1bf7690c67d80591b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:30.345097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44e54c-3649-4c8b-884b-4471990181e6 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.345377 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44e54c-3649-4c8b-884b-4471990181e6 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.345644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44e54c-3649-4c8b-884b-4471990181e6 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.347002 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 316/632] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:30.347549 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44e54c-3649-4c8b-884b-4471990181e6 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.364807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:30.369918 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec89bf-c89a-477d-9974-a4da63485704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.371345 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec89bf-c89a-477d-9974-a4da63485704 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.371799 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec89bf-c89a-477d-9974-a4da63485704 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.372291 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec89bf-c89a-477d-9974-a4da63485704 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.373948 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec89bf-c89a-477d-9974-a4da63485704 None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:30.374515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec89bf-c89a-477d-9974-a4da63485704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.376946 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec89bf-c89a-477d-9974-a4da63485704 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.391495 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 317/633] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:30.393119 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bfbf9-c245-4ef6-b97a-0160780ea89d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.393534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bfbf9-c245-4ef6-b97a-0160780ea89d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.393933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bfbf9-c245-4ef6-b97a-0160780ea89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.420155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-d16bfbf9-c245-4ef6-b97a-0160780ea89d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:30.421621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-d16bfbf9-c245-4ef6-b97a-0160780ea89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:30.504073 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 318/634] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:30.504073 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bfbf9-c245-4ef6-b97a-0160780ea89d None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.525025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44e54c-3649-4c8b-884b-4471990181e6 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.574440 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974728a-5fa7-46f4-95f1-59f5347a34f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.575061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974728a-5fa7-46f4-95f1-59f5347a34f5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.575337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974728a-5fa7-46f4-95f1-59f5347a34f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.575752 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974728a-5fa7-46f4-95f1-59f5347a34f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.613559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:30.640313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bfbf9-c245-4ef6-b97a-0160780ea89d None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.663653 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974728a-5fa7-46f4-95f1-59f5347a34f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.665652 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974728a-5fa7-46f4-95f1-59f5347a34f5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.681069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:30.683113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfb80b-e97d-4621-9d18-410db31764e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.684374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb80b-e97d-4621-9d18-410db31764e1 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.684878 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb80b-e97d-4621-9d18-410db31764e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.686010 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb80b-e97d-4621-9d18-410db31764e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.700022 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfb80b-e97d-4621-9d18-410db31764e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.702516 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfb80b-e97d-4621-9d18-410db31764e1 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-dcbfb80b-e97d-4621-9d18-410db31764e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:30.721564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:30.722798 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:30.724099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:30.724099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:30.724099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:30.726041 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 319/635] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:30.727513 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8edf7-ec82-457c-a26c-15f761c4d12c None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.727952 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8edf7-ec82-457c-a26c-15f761c4d12c None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.728635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8edf7-ec82-457c-a26c-15f761c4d12c None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.731245 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 320/636] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:30.732557 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8edf7-ec82-457c-a26c-15f761c4d12c None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.806025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 317/637] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:30.807416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e6c36-5c81-4ed5-9d41-04a4dfc7c825 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.807768 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e6c36-5c81-4ed5-9d41-04a4dfc7c825 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.808169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e6c36-5c81-4ed5-9d41-04a4dfc7c825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.826408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f79e6c36-5c81-4ed5-9d41-04a4dfc7c825 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:30.827591 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f79e6c36-5c81-4ed5-9d41-04a4dfc7c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:30.867157 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8edf7-ec82-457c-a26c-15f761c4d12c None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.899544 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 318/638] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:30.900305 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e6c36-5c81-4ed5-9d41-04a4dfc7c825 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.901493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:30.907471 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace7768-d411-4aed-b146-4abe195f118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.908255 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace7768-d411-4aed-b146-4abe195f118f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.908530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace7768-d411-4aed-b146-4abe195f118f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.908795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace7768-d411-4aed-b146-4abe195f118f None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.909481 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace7768-d411-4aed-b146-4abe195f118f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:30.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace7768-d411-4aed-b146-4abe195f118f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.911268 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace7768-d411-4aed-b146-4abe195f118f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.929489 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 321/639] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:30.930583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace7768-d411-4aed-b146-4abe195f118f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.955206 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:31.016810 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e6c36-5c81-4ed5-9d41-04a4dfc7c825 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.041959 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace7768-d411-4aed-b146-4abe195f118f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.053038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4febbe-09d2-489a-865b-5262f4dda6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.054055 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4febbe-09d2-489a-865b-5262f4dda6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.054540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4febbe-09d2-489a-865b-5262f4dda6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.055013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4febbe-09d2-489a-865b-5262f4dda6d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.065733 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4febbe-09d2-489a-865b-5262f4dda6d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-8d4febbe-09d2-489a-865b-5262f4dda6d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:31.070823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:31.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:31.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:31.076569 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 319/640] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:31.077632 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4febbe-09d2-489a-865b-5262f4dda6d8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.084204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec361-0d0e-4920-9dfb-84c54318f5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.084849 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec361-0d0e-4920-9dfb-84c54318f5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.085119 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec361-0d0e-4920-9dfb-84c54318f5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.085382 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ec361-0d0e-4920-9dfb-84c54318f5b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.096603 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ec361-0d0e-4920-9dfb-84c54318f5b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.098094 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ec361-0d0e-4920-9dfb-84c54318f5b9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-ae4ec361-0d0e-4920-9dfb-84c54318f5b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:31.113920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:31.115040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:31.116002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:31.116002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:31.116002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:31.120593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 322/641] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:31.121078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec361-0d0e-4920-9dfb-84c54318f5b9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.170042 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:31.185658 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:31.189470 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4febbe-09d2-489a-865b-5262f4dda6d8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.226726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ec361-0d0e-4920-9dfb-84c54318f5b9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.227347 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882118c-1148-478e-b788-6b4fa66eb88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.227972 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882118c-1148-478e-b788-6b4fa66eb88f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.228264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882118c-1148-478e-b788-6b4fa66eb88f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.228527 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882118c-1148-478e-b788-6b4fa66eb88f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.235834 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882118c-1148-478e-b788-6b4fa66eb88f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.237318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882118c-1148-478e-b788-6b4fa66eb88f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7882118c-1148-478e-b788-6b4fa66eb88f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:31.249403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:31.250492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:31.252167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:31.252167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:31.252167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:31.252167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:31.252167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:31.252167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:31.252167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:31.252167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:31.252167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:31.252167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:31.255335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 320/642] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:31.256138 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882118c-1148-478e-b788-6b4fa66eb88f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.264930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0da49-e84f-4c28-a67c-1daab499d07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.266002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0da49-e84f-4c28-a67c-1daab499d07e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.266002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0da49-e84f-4c28-a67c-1daab499d07e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.266237 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0da49-e84f-4c28-a67c-1daab499d07e None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.266829 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0da49-e84f-4c28-a67c-1daab499d07e None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:31.267123 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0da49-e84f-4c28-a67c-1daab499d07e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.268502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0da49-e84f-4c28-a67c-1daab499d07e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.276753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 323/643] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:31.282107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0da49-e84f-4c28-a67c-1daab499d07e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.363954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882118c-1148-478e-b788-6b4fa66eb88f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.388409 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0da49-e84f-4c28-a67c-1daab499d07e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.396182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:31.401833 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896f4f9-1ce7-433b-a5db-6e26425254b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.402449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896f4f9-1ce7-433b-a5db-6e26425254b1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.402750 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896f4f9-1ce7-433b-a5db-6e26425254b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.403006 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896f4f9-1ce7-433b-a5db-6e26425254b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.403647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896f4f9-1ce7-433b-a5db-6e26425254b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:31.403949 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896f4f9-1ce7-433b-a5db-6e26425254b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.405369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896f4f9-1ce7-433b-a5db-6e26425254b1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.423082 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 321/644] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:31.423082 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896f4f9-1ce7-433b-a5db-6e26425254b1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.429843 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b917c-dd80-4074-bf77-7b9db7f96b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.430620 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b917c-dd80-4074-bf77-7b9db7f96b1f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.430902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b917c-dd80-4074-bf77-7b9db7f96b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.431169 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b917c-dd80-4074-bf77-7b9db7f96b1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.443520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b917c-dd80-4074-bf77-7b9db7f96b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:31.444754 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-1f2b917c-dd80-4074-bf77-7b9db7f96b1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:31.450888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:31.451871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 324/645] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:31.453254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b917c-dd80-4074-bf77-7b9db7f96b1f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.532963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896f4f9-1ce7-433b-a5db-6e26425254b1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.556007 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b917c-dd80-4074-bf77-7b9db7f96b1f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.569846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d9367-c8c7-44e2-a6f1-7101de147534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.570797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d9367-c8c7-44e2-a6f1-7101de147534 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.571284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d9367-c8c7-44e2-a6f1-7101de147534 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.571871 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d9367-c8c7-44e2-a6f1-7101de147534 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.572951 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d9367-c8c7-44e2-a6f1-7101de147534 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:31.573480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d9367-c8c7-44e2-a6f1-7101de147534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.575257 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d9367-c8c7-44e2-a6f1-7101de147534 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.590340 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197f890-0955-40da-a1a5-29cf19ad26b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.590958 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197f890-0955-40da-a1a5-29cf19ad26b9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.591234 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197f890-0955-40da-a1a5-29cf19ad26b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.591503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197f890-0955-40da-a1a5-29cf19ad26b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.599785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 322/646] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:31.601112 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d9367-c8c7-44e2-a6f1-7101de147534 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.602689 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197f890-0955-40da-a1a5-29cf19ad26b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.604327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197f890-0955-40da-a1a5-29cf19ad26b9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-c197f890-0955-40da-a1a5-29cf19ad26b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:31.620609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:31.621622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:31.622596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:31.622596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:31.622596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:31.622596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 325/647] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:31.622596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197f890-0955-40da-a1a5-29cf19ad26b9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.643441 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:31.696248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:31.723158 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d9367-c8c7-44e2-a6f1-7101de147534 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.731398 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197f890-0955-40da-a1a5-29cf19ad26b9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.761872 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117e30-9999-43a4-9389-1ea68baccfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.762530 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117e30-9999-43a4-9389-1ea68baccfac None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.762804 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117e30-9999-43a4-9389-1ea68baccfac None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.763070 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117e30-9999-43a4-9389-1ea68baccfac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.766609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9ad6c-8e50-4e18-9910-0fa328e6e4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.767213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9ad6c-8e50-4e18-9910-0fa328e6e4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.767486 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9ad6c-8e50-4e18-9910-0fa328e6e4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.767750 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9ad6c-8e50-4e18-9910-0fa328e6e4c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.768448 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9ad6c-8e50-4e18-9910-0fa328e6e4c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:31.771559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9ad6c-8e50-4e18-9910-0fa328e6e4c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.771698 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d117e30-9999-43a4-9389-1ea68baccfac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.771780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9ad6c-8e50-4e18-9910-0fa328e6e4c1 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.771853 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d117e30-9999-43a4-9389-1ea68baccfac None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.784060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 326/648] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:31.784060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9ad6c-8e50-4e18-9910-0fa328e6e4c1 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-8d117e30-9999-43a4-9389-1ea68baccfac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:31.784318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:31.786030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:31.787062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:31.787062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:31.787062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:31.787062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:31.787062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:31.787062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:31.787062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:31.787062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:31.788857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 323/649] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:31.789718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117e30-9999-43a4-9389-1ea68baccfac None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.871112 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:31.891954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9ad6c-8e50-4e18-9910-0fa328e6e4c1 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.894937 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117e30-9999-43a4-9389-1ea68baccfac None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.926960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e58f25-f814-4089-9dda-7bb303d48a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.927712 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58f25-f814-4089-9dda-7bb303d48a0c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.928003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58f25-f814-4089-9dda-7bb303d48a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.928308 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58f25-f814-4089-9dda-7bb303d48a0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.929953 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e348b55-70c4-4bd6-8ecf-7935255421db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.930555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e348b55-70c4-4bd6-8ecf-7935255421db None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.930937 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e348b55-70c4-4bd6-8ecf-7935255421db None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.931208 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e348b55-70c4-4bd6-8ecf-7935255421db None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.931935 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e348b55-70c4-4bd6-8ecf-7935255421db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:31.932255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e348b55-70c4-4bd6-8ecf-7935255421db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.933656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e348b55-70c4-4bd6-8ecf-7935255421db None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.940768 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:31.951528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 324/650] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:31.951528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e348b55-70c4-4bd6-8ecf-7935255421db None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.004509 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e58f25-f814-4089-9dda-7bb303d48a0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.006013 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e58f25-f814-4089-9dda-7bb303d48a0c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.048826 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e348b55-70c4-4bd6-8ecf-7935255421db None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.082188 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80373c1-8802-48a5-be5a-723cce04f570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.082821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80373c1-8802-48a5-be5a-723cce04f570 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.083114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80373c1-8802-48a5-be5a-723cce04f570 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.083380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80373c1-8802-48a5-be5a-723cce04f570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.088811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:32.093595 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80373c1-8802-48a5-be5a-723cce04f570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.095038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80373c1-8802-48a5-be5a-723cce04f570 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e80373c1-8802-48a5-be5a-723cce04f570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:32.110320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:32.111773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:32.112754 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:32.112754 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:32.112754 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:32.112932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 327/651] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:32.112932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e58f25-f814-4089-9dda-7bb303d48a0c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.116182 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 325/652] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:32.116871 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80373c1-8802-48a5-be5a-723cce04f570 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.165144 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:32.213500 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80373c1-8802-48a5-be5a-723cce04f570 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.219826 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e58f25-f814-4089-9dda-7bb303d48a0c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.246856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ecb3d-29d3-4463-839d-355fafa3a760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.247476 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ecb3d-29d3-4463-839d-355fafa3a760 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.247751 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ecb3d-29d3-4463-839d-355fafa3a760 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.248026 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ecb3d-29d3-4463-839d-355fafa3a760 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.255568 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ecb3d-29d3-4463-839d-355fafa3a760 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.255863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e455ab-f52b-4fbb-9d91-30e3f411fd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.256460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e455ab-f52b-4fbb-9d91-30e3f411fd3e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.256736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e455ab-f52b-4fbb-9d91-30e3f411fd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.257305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e455ab-f52b-4fbb-9d91-30e3f411fd3e None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.257415 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ecb3d-29d3-4463-839d-355fafa3a760 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.257975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e455ab-f52b-4fbb-9d91-30e3f411fd3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:32.258270 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e455ab-f52b-4fbb-9d91-30e3f411fd3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.259670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e455ab-f52b-4fbb-9d91-30e3f411fd3e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-eb3ecb3d-29d3-4463-839d-355fafa3a760 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:32.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:32.269718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 326/653] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:32.271681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ecb3d-29d3-4463-839d-355fafa3a760 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.276579 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 328/654] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:32.277513 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e455ab-f52b-4fbb-9d91-30e3f411fd3e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.322718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:32.381547 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ecb3d-29d3-4463-839d-355fafa3a760 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.384860 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e455ab-f52b-4fbb-9d91-30e3f411fd3e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.392495 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:32.419324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b949d-bd80-4fa0-af87-9ac2ad5a7f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.420199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b949d-bd80-4fa0-af87-9ac2ad5a7f9a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.420431 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f1e4f-4201-46da-8c28-e0137fdd8dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.420551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b949d-bd80-4fa0-af87-9ac2ad5a7f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.420738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b949d-bd80-4fa0-af87-9ac2ad5a7f9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.420998 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1e4f-4201-46da-8c28-e0137fdd8dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.421269 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1e4f-4201-46da-8c28-e0137fdd8dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.421532 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f1e4f-4201-46da-8c28-e0137fdd8dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.422153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f1e4f-4201-46da-8c28-e0137fdd8dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:32.422448 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f1e4f-4201-46da-8c28-e0137fdd8dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.423802 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f1e4f-4201-46da-8c28-e0137fdd8dd7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.433228 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b949d-bd80-4fa0-af87-9ac2ad5a7f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.434665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b949d-bd80-4fa0-af87-9ac2ad5a7f9a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.435794 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 329/655] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:32.441648 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f1e4f-4201-46da-8c28-e0137fdd8dd7 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-8b8b949d-bd80-4fa0-af87-9ac2ad5a7f9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:32.450395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:32.451459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:32.452411 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:32.452411 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:32.452411 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:32.456173 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 327/656] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:32.457010 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b949d-bd80-4fa0-af87-9ac2ad5a7f9a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.551321 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:32.555617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f1e4f-4201-46da-8c28-e0137fdd8dd7 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.564202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b949d-bd80-4fa0-af87-9ac2ad5a7f9a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.593409 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3380aa2-276e-4f32-9251-8ebd8515560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.594023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3380aa2-276e-4f32-9251-8ebd8515560f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.594292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3380aa2-276e-4f32-9251-8ebd8515560f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.594563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3380aa2-276e-4f32-9251-8ebd8515560f None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.595297 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3380aa2-276e-4f32-9251-8ebd8515560f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:32.595647 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3380aa2-276e-4f32-9251-8ebd8515560f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.597109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3380aa2-276e-4f32-9251-8ebd8515560f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.601579 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9163c8-babc-45bc-a30e-5f0f0d7a8cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.602407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9163c8-babc-45bc-a30e-5f0f0d7a8cfa None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.602864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9163c8-babc-45bc-a30e-5f0f0d7a8cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.603332 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9163c8-babc-45bc-a30e-5f0f0d7a8cfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.604527 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9163c8-babc-45bc-a30e-5f0f0d7a8cfa None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=dbbd529122d64e46a70f62e351b27fd1) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:32.605243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9163c8-babc-45bc-a30e-5f0f0d7a8cfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.607678 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9163c8-babc-45bc-a30e-5f0f0d7a8cfa None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.618906 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 328/657] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:32 2022] GET /identity/v3/role_assignments?user.id=dbbd529122d64e46a70f62e351b27fd1&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:32.619141 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 330/658] 10.222.0.43 () {56 vars in 1139 bytes} [Sun Oct 9 00:43:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:32.619141 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3380aa2-276e-4f32-9251-8ebd8515560f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.623316 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9163c8-babc-45bc-a30e-5f0f0d7a8cfa None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.655709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:32.737394 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9163c8-babc-45bc-a30e-5f0f0d7a8cfa None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.738941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3380aa2-276e-4f32-9251-8ebd8515560f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.778226 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe8466-9d8c-42c6-bac8-2e0da63a0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.778871 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe8466-9d8c-42c6-bac8-2e0da63a0839 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.779146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe8466-9d8c-42c6-bac8-2e0da63a0839 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.779414 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe8466-9d8c-42c6-bac8-2e0da63a0839 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.784272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d6118-812c-4da7-8db5-8a0146960d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.784897 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d6118-812c-4da7-8db5-8a0146960d77 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.785173 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d6118-812c-4da7-8db5-8a0146960d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.785440 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d6118-812c-4da7-8db5-8a0146960d77 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.786079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d6118-812c-4da7-8db5-8a0146960d77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:32.786474 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d6118-812c-4da7-8db5-8a0146960d77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.790484 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe8466-9d8c-42c6-bac8-2e0da63a0839 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.790627 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d6118-812c-4da7-8db5-8a0146960d77 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.790705 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe8466-9d8c-42c6-bac8-2e0da63a0839 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.801386 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 331/659] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:32.802324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d6118-812c-4da7-8db5-8a0146960d77 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-3fbe8466-9d8c-42c6-bac8-2e0da63a0839 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:32.804349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:32.805337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:32.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:32.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:32.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:32.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:32.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:32.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:32.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:32.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:32.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:43:32.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:32.806327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 329/660] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:32.807917 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c736d-3215-4dfd-aa5d-59a436856edf None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.809278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c736d-3215-4dfd-aa5d-59a436856edf None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.810253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c736d-3215-4dfd-aa5d-59a436856edf None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.811831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 330/661] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:32.812836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c736d-3215-4dfd-aa5d-59a436856edf None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.830909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:32.917872 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:32.926733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d6118-812c-4da7-8db5-8a0146960d77 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.934595 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c736d-3215-4dfd-aa5d-59a436856edf None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.966087 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7058d1-79c4-4a6e-a38c-c5168c446827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.966701 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7058d1-79c4-4a6e-a38c-c5168c446827 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.966979 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7058d1-79c4-4a6e-a38c-c5168c446827 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.967241 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7058d1-79c4-4a6e-a38c-c5168c446827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.973397 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51284d-68c1-4322-95a8-de77dfb9276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.974269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51284d-68c1-4322-95a8-de77dfb9276d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.974480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51284d-68c1-4322-95a8-de77dfb9276d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.974809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51284d-68c1-4322-95a8-de77dfb9276d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.982176 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51284d-68c1-4322-95a8-de77dfb9276d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.983729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51284d-68c1-4322-95a8-de77dfb9276d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-2c51284d-68c1-4322-95a8-de77dfb9276d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:32.996107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:32.997104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:32.998036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:32.998036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:32.998036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:32.998036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:32.998036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:32.998036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:32.998036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:32.998036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:32.998036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 331/662] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:32.998036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51284d-68c1-4322-95a8-de77dfb9276d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.044221 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7058d1-79c4-4a6e-a38c-c5168c446827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:33.046061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7058d1-79c4-4a6e-a38c-c5168c446827 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:33.066629 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:33.106774 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51284d-68c1-4322-95a8-de77dfb9276d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:33.144590 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa71d1-4115-41e1-a1d4-83232cd69898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:33.145200 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa71d1-4115-41e1-a1d4-83232cd69898 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.145826 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa71d1-4115-41e1-a1d4-83232cd69898 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.145826 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa71d1-4115-41e1-a1d4-83232cd69898 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.146544 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa71d1-4115-41e1-a1d4-83232cd69898 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:33.146847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa71d1-4115-41e1-a1d4-83232cd69898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:33.148335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa71d1-4115-41e1-a1d4-83232cd69898 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:33.152819 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 332/663] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:33.157838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab560ba1-183a-46f9-9ac5-31e57a8a4b69 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.157838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab560ba1-183a-46f9-9ac5-31e57a8a4b69 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.157838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab560ba1-183a-46f9-9ac5-31e57a8a4b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.174040 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 332/664] 10.222.0.43 () {56 vars in 1137 bytes} [Sun Oct 9 00:43:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:33.174040 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa71d1-4115-41e1-a1d4-83232cd69898 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.175423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-ab560ba1-183a-46f9-9ac5-31e57a8a4b69 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:33.176624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-ab560ba1-183a-46f9-9ac5-31e57a8a4b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:33.178831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:33.250087 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 333/665] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:33.250087 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab560ba1-183a-46f9-9ac5-31e57a8a4b69 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.284683 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa71d1-4115-41e1-a1d4-83232cd69898 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:33.311191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:33.323714 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a50086-75c5-494d-8ccb-bc7d6819c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:33.324580 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a50086-75c5-494d-8ccb-bc7d6819c84c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.325180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a50086-75c5-494d-8ccb-bc7d6819c84c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.325595 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a50086-75c5-494d-8ccb-bc7d6819c84c None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.326512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a50086-75c5-494d-8ccb-bc7d6819c84c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:33.326958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a50086-75c5-494d-8ccb-bc7d6819c84c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:33.328563 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a50086-75c5-494d-8ccb-bc7d6819c84c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:33.343073 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 333/666] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:33.344149 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a50086-75c5-494d-8ccb-bc7d6819c84c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.368301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab560ba1-183a-46f9-9ac5-31e57a8a4b69 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:33.408081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e92df-b2e3-4bdd-bb0a-ec560aa1485c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:33.408841 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e92df-b2e3-4bdd-bb0a-ec560aa1485c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.409164 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e92df-b2e3-4bdd-bb0a-ec560aa1485c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.409480 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e92df-b2e3-4bdd-bb0a-ec560aa1485c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.412077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:33.423618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e92df-b2e3-4bdd-bb0a-ec560aa1485c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:33.425333 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e92df-b2e3-4bdd-bb0a-ec560aa1485c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-8e8e92df-b2e3-4bdd-bb0a-ec560aa1485c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:33.443362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:33.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:33.445376 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:33.445376 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:33.445376 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:33.445376 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 334/667] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:33.445887 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e92df-b2e3-4bdd-bb0a-ec560aa1485c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.465071 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a50086-75c5-494d-8ccb-bc7d6819c84c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:33.514534 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a912ae-9cf1-4040-b253-0dd9370e39a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:33.515151 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a912ae-9cf1-4040-b253-0dd9370e39a9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.515503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a912ae-9cf1-4040-b253-0dd9370e39a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.516076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a912ae-9cf1-4040-b253-0dd9370e39a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.556205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:33.559188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e92df-b2e3-4bdd-bb0a-ec560aa1485c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:33.595736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774fbfe-c982-4146-8aec-d715e7395efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:33.597260 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774fbfe-c982-4146-8aec-d715e7395efa None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.597684 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774fbfe-c982-4146-8aec-d715e7395efa None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.598380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774fbfe-c982-4146-8aec-d715e7395efa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.599128 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a912ae-9cf1-4040-b253-0dd9370e39a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:33.599612 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774fbfe-c982-4146-8aec-d715e7395efa None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=f960fdabbffa4813a0ea46bb82218f09) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:33.600096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774fbfe-c982-4146-8aec-d715e7395efa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:33.600703 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a912ae-9cf1-4040-b253-0dd9370e39a9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:33.601812 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774fbfe-c982-4146-8aec-d715e7395efa None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:33.616090 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 335/668] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:33 2022] GET /identity/v3/role_assignments?user.id=f960fdabbffa4813a0ea46bb82218f09&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:33.616090 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774fbfe-c982-4146-8aec-d715e7395efa None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.687245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:33.736607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774fbfe-c982-4146-8aec-d715e7395efa None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:33.742148 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 334/669] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:33.743034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a912ae-9cf1-4040-b253-0dd9370e39a9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.785741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b823ae-5371-410e-b629-806120f199a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:33.786572 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b823ae-5371-410e-b629-806120f199a2 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.788278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b823ae-5371-410e-b629-806120f199a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.788278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b823ae-5371-410e-b629-806120f199a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.788878 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b823ae-5371-410e-b629-806120f199a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:33.789243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b823ae-5371-410e-b629-806120f199a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:33.793543 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b823ae-5371-410e-b629-806120f199a2 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:33.810991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 336/670] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:33.812161 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b823ae-5371-410e-b629-806120f199a2 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.855509 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:33.869739 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a912ae-9cf1-4040-b253-0dd9370e39a9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:33.914506 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f1c4c-28d4-4ea7-8089-bf930c105e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:33.916393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f1c4c-28d4-4ea7-8089-bf930c105e0c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.916879 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f1c4c-28d4-4ea7-8089-bf930c105e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.917340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f1c4c-28d4-4ea7-8089-bf930c105e0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.931686 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f1c4c-28d4-4ea7-8089-bf930c105e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-f70f1c4c-28d4-4ea7-8089-bf930c105e0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:33.937523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:33.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 335/671] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:33.939843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f1c4c-28d4-4ea7-8089-bf930c105e0c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.956444 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b823ae-5371-410e-b629-806120f199a2 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:33.973559 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:33.999201 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650947e-1373-4b60-9842-ad4ac89627d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:33.999844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650947e-1373-4b60-9842-ad4ac89627d0 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.000243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650947e-1373-4b60-9842-ad4ac89627d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.000518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650947e-1373-4b60-9842-ad4ac89627d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.012611 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650947e-1373-4b60-9842-ad4ac89627d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.014262 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650947e-1373-4b60-9842-ad4ac89627d0 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-4650947e-1373-4b60-9842-ad4ac89627d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:34.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:34.031605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:34.032641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:34.032641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:34.032641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:34.032641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 337/672] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:34.032891 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650947e-1373-4b60-9842-ad4ac89627d0 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.067211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f1c4c-28d4-4ea7-8089-bf930c105e0c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.113165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97b47d-7467-44d7-a013-74e1aec9995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.113856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b47d-7467-44d7-a013-74e1aec9995b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.114141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b47d-7467-44d7-a013-74e1aec9995b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.114564 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b47d-7467-44d7-a013-74e1aec9995b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.120656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:34.123717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97b47d-7467-44d7-a013-74e1aec9995b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.125964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97b47d-7467-44d7-a013-74e1aec9995b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-cf97b47d-7467-44d7-a013-74e1aec9995b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:34.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:34.146724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:34.147641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:34.147641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:34.147641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:34.147641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:34.147641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:34.147641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:34.147641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:34.147641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:34.147641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 336/673] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:34.148177 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97b47d-7467-44d7-a013-74e1aec9995b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.152238 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650947e-1373-4b60-9842-ad4ac89627d0 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.198610 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add6b5-e7f3-4f21-8686-d3cd328ee02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.199259 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add6b5-e7f3-4f21-8686-d3cd328ee02b None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.199488 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add6b5-e7f3-4f21-8686-d3cd328ee02b None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.199756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add6b5-e7f3-4f21-8686-d3cd328ee02b None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.200719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0add6b5-e7f3-4f21-8686-d3cd328ee02b None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:34.201025 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0add6b5-e7f3-4f21-8686-d3cd328ee02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.202639 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0add6b5-e7f3-4f21-8686-d3cd328ee02b None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.215073 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 338/674] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:34.216173 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add6b5-e7f3-4f21-8686-d3cd328ee02b None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.241081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:34.258959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97b47d-7467-44d7-a013-74e1aec9995b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.297213 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd8341-4b50-45cc-91b5-c88c23c4ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.298691 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8341-4b50-45cc-91b5-c88c23c4ef50 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.299191 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8341-4b50-45cc-91b5-c88c23c4ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.299653 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8341-4b50-45cc-91b5-c88c23c4ef50 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.300888 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd8341-4b50-45cc-91b5-c88c23c4ef50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:34.301388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd8341-4b50-45cc-91b5-c88c23c4ef50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.303195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd8341-4b50-45cc-91b5-c88c23c4ef50 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.318670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 337/675] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:34.320164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd8341-4b50-45cc-91b5-c88c23c4ef50 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.347699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add6b5-e7f3-4f21-8686-d3cd328ee02b None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.389789 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125931d-a9b7-4df5-bc48-7d4072acad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.390834 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125931d-a9b7-4df5-bc48-7d4072acad7f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.391210 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125931d-a9b7-4df5-bc48-7d4072acad7f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.391574 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125931d-a9b7-4df5-bc48-7d4072acad7f None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.392526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125931d-a9b7-4df5-bc48-7d4072acad7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:34.392988 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125931d-a9b7-4df5-bc48-7d4072acad7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.394604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125931d-a9b7-4df5-bc48-7d4072acad7f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.403938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:34.411705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 339/676] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:34.412928 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125931d-a9b7-4df5-bc48-7d4072acad7f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.445701 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd8341-4b50-45cc-91b5-c88c23c4ef50 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.484013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d47308-001d-43d1-83cd-f681e8dcaee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.484692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d47308-001d-43d1-83cd-f681e8dcaee4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.484970 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d47308-001d-43d1-83cd-f681e8dcaee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.485225 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d47308-001d-43d1-83cd-f681e8dcaee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.496235 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d47308-001d-43d1-83cd-f681e8dcaee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.497744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d47308-001d-43d1-83cd-f681e8dcaee4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.500354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-22d47308-001d-43d1-83cd-f681e8dcaee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:34.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:34.515168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:34.516127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:34.516127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:34.516127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:34.516127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 338/677] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:34.516810 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d47308-001d-43d1-83cd-f681e8dcaee4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.544997 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125931d-a9b7-4df5-bc48-7d4072acad7f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.588812 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d214-b4bb-477c-86bf-dd61adb6d42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.589902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d214-b4bb-477c-86bf-dd61adb6d42d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.590364 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d214-b4bb-477c-86bf-dd61adb6d42d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.590816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d214-b4bb-477c-86bf-dd61adb6d42d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.598790 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d214-b4bb-477c-86bf-dd61adb6d42d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.600582 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d214-b4bb-477c-86bf-dd61adb6d42d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-c9d1d214-b4bb-477c-86bf-dd61adb6d42d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:34.615514 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:34.616559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:34.617482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:34.617482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:34.617482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:34.617482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:34.617482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:34.617482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:34.617482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:34.617482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:34.620704 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 340/678] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:34.622233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d214-b4bb-477c-86bf-dd61adb6d42d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.623489 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d47308-001d-43d1-83cd-f681e8dcaee4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.660385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59394f-d7d1-4c1d-bace-56362fd5284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.660992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59394f-d7d1-4c1d-bace-56362fd5284a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.661376 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59394f-d7d1-4c1d-bace-56362fd5284a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.661867 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59394f-d7d1-4c1d-bace-56362fd5284a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.662696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59394f-d7d1-4c1d-bace-56362fd5284a None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=a33cbccb6a374b5f941fd4b768ff6766) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:34.663006 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59394f-d7d1-4c1d-bace-56362fd5284a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.664573 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59394f-d7d1-4c1d-bace-56362fd5284a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.670569 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 339/679] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:34 2022] GET /identity/v3/role_assignments?user.id=a33cbccb6a374b5f941fd4b768ff6766&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:34.671357 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59394f-d7d1-4c1d-bace-56362fd5284a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.693640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:34.741212 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:34.747294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d214-b4bb-477c-86bf-dd61adb6d42d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.796550 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa966d-659c-431f-987e-7e4cb00e54ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.797657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa966d-659c-431f-987e-7e4cb00e54ce None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.798082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa966d-659c-431f-987e-7e4cb00e54ce None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.798489 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa966d-659c-431f-987e-7e4cb00e54ce None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.799302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa966d-659c-431f-987e-7e4cb00e54ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:34.799430 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59394f-d7d1-4c1d-bace-56362fd5284a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.799854 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa966d-659c-431f-987e-7e4cb00e54ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.801559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa966d-659c-431f-987e-7e4cb00e54ce None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.815206 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 341/680] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:34.820547 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa966d-659c-431f-987e-7e4cb00e54ce None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.869039 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a9ffb-2949-4f6b-8ab3-5a3b3b1cddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.869621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9ffb-2949-4f6b-8ab3-5a3b3b1cddc8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.869899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9ffb-2949-4f6b-8ab3-5a3b3b1cddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.870166 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9ffb-2949-4f6b-8ab3-5a3b3b1cddc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.870945 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a9ffb-2949-4f6b-8ab3-5a3b3b1cddc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:34.871265 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a9ffb-2949-4f6b-8ab3-5a3b3b1cddc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.872807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a9ffb-2949-4f6b-8ab3-5a3b3b1cddc8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.895243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 340/681] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:34.901016 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a9ffb-2949-4f6b-8ab3-5a3b3b1cddc8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.944316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa966d-659c-431f-987e-7e4cb00e54ce None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.965678 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:34.993008 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338be690-69dc-4db8-93a5-aec00e402203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.994126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be690-69dc-4db8-93a5-aec00e402203 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.994594 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be690-69dc-4db8-93a5-aec00e402203 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.995079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be690-69dc-4db8-93a5-aec00e402203 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.008276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338be690-69dc-4db8-93a5-aec00e402203 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:35.010198 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338be690-69dc-4db8-93a5-aec00e402203 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-338be690-69dc-4db8-93a5-aec00e402203 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:35.023669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:35.024809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:35.025780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:35.025780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:35.025780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:35.025780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:35.025780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:35.025780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:35.025780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:35.025780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:35.025780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:35.025780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:35.025780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 342/682] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:35.026924 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb36a71-a736-4032-a228-e30122de848d None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:35.027090 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb36a71-a736-4032-a228-e30122de848d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:35.028011 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb36a71-a736-4032-a228-e30122de848d None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.029576 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 343/683] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:35.031305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb36a71-a736-4032-a228-e30122de848d None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:35.083539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a9ffb-2949-4f6b-8ab3-5a3b3b1cddc8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:35.110136 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:35.128788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e402992-c237-4c4b-a810-b6b6c4c582d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:35.129323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e402992-c237-4c4b-a810-b6b6c4c582d6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:35.129597 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e402992-c237-4c4b-a810-b6b6c4c582d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:35.129918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e402992-c237-4c4b-a810-b6b6c4c582d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.130715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e402992-c237-4c4b-a810-b6b6c4c582d6 None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=a44cd61c1bfd4ed29e7ede8f8e3a22be) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:35.131024 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e402992-c237-4c4b-a810-b6b6c4c582d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:35.132811 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e402992-c237-4c4b-a810-b6b6c4c582d6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:35.141375 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 341/684] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:34 2022] GET /identity/v3/role_assignments?user.id=a44cd61c1bfd4ed29e7ede8f8e3a22be&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:35.142745 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c606f4-a9a0-4def-ba20-217f41150f6d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:35.143032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c606f4-a9a0-4def-ba20-217f41150f6d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:35.143312 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c606f4-a9a0-4def-ba20-217f41150f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.154104 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb36a71-a736-4032-a228-e30122de848d None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:35.183633 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-15c606f4-a9a0-4def-ba20-217f41150f6d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:35.185515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-15c606f4-a9a0-4def-ba20-217f41150f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:35.227689 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f166c-f8ae-4653-84af-a28d4577a1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:35.229081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f166c-f8ae-4653-84af-a28d4577a1cd None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:35.229685 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f166c-f8ae-4653-84af-a28d4577a1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:35.231869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f166c-f8ae-4653-84af-a28d4577a1cd None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.233372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f166c-f8ae-4653-84af-a28d4577a1cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:35.234064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f166c-f8ae-4653-84af-a28d4577a1cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:35.237266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f166c-f8ae-4653-84af-a28d4577a1cd None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:35.275298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 344/685] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Oct 9 00:43:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:35.281989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f166c-f8ae-4653-84af-a28d4577a1cd None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:35.330764 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 342/686] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:35.348467 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:35.417811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f166c-f8ae-4653-84af-a28d4577a1cd None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:35.454212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ab930-01d1-4cef-ac76-25801af8cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:35.454818 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab930-01d1-4cef-ac76-25801af8cb9d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:35.455088 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab930-01d1-4cef-ac76-25801af8cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:35.455352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab930-01d1-4cef-ac76-25801af8cb9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.528465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ab930-01d1-4cef-ac76-25801af8cb9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:35.529896 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ab930-01d1-4cef-ac76-25801af8cb9d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:35.564534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:35.633778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 345/687] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 09 00:43:35.639055 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c606f4-a9a0-4def-ba20-217f41150f6d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:35.708321 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ab930-01d1-4cef-ac76-25801af8cb9d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:35.753662 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c606f4-a9a0-4def-ba20-217f41150f6d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:35.770817 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:35.798764 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88c6f-88a2-453d-92f4-a0232907c6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:35.799415 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88c6f-88a2-453d-92f4-a0232907c6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:35.799687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88c6f-88a2-453d-92f4-a0232907c6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:35.799951 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88c6f-88a2-453d-92f4-a0232907c6f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.829368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc88c6f-88a2-453d-92f4-a0232907c6f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:35.830981 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc88c6f-88a2-453d-92f4-a0232907c6f5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ddc88c6f-88a2-453d-92f4-a0232907c6f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:35.870211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:35.871249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:35.872222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:35.872222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:35.872222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:35.880373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 343/688] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:35.887646 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88c6f-88a2-453d-92f4-a0232907c6f5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:35.895626 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ab930-01d1-4cef-ac76-25801af8cb9d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:35.938174 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3830e0d-0b7e-4131-bd2b-9d1e934356bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:35.939838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3830e0d-0b7e-4131-bd2b-9d1e934356bc None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:35.940139 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3830e0d-0b7e-4131-bd2b-9d1e934356bc None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:35.941768 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3830e0d-0b7e-4131-bd2b-9d1e934356bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.947614 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:35.961829 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3830e0d-0b7e-4131-bd2b-9d1e934356bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:35.963216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3830e0d-0b7e-4131-bd2b-9d1e934356bc None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-f3830e0d-0b7e-4131-bd2b-9d1e934356bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:35.997654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:35.999852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:36.002109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:36.002109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:36.002109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:36.002109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 346/689] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:36.002109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e49fc-40a0-46dd-b161-598e4e9737d0 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.002109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e49fc-40a0-46dd-b161-598e4e9737d0 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.002109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e49fc-40a0-46dd-b161-598e4e9737d0 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.007120 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 347/690] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:36.007962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e49fc-40a0-46dd-b161-598e4e9737d0 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:36.066454 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88c6f-88a2-453d-92f4-a0232907c6f5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:36.107921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50291fee-5b79-4fde-a9db-e2441c53751c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:36.108733 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291fee-5b79-4fde-a9db-e2441c53751c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.108975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291fee-5b79-4fde-a9db-e2441c53751c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.109249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291fee-5b79-4fde-a9db-e2441c53751c None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.110188 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50291fee-5b79-4fde-a9db-e2441c53751c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:36.110737 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50291fee-5b79-4fde-a9db-e2441c53751c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:36.112382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50291fee-5b79-4fde-a9db-e2441c53751c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:36.120143 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e49fc-40a0-46dd-b161-598e4e9737d0 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:36.127554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 344/691] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:36.129352 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c012e-9534-4447-ab18-b96079024689 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.129641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c012e-9534-4447-ab18-b96079024689 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.129948 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c012e-9534-4447-ab18-b96079024689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.153181 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-123c012e-9534-4447-ab18-b96079024689 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:36.154619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-123c012e-9534-4447-ab18-b96079024689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:36.158580 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78590-26c0-44a7-8133-9acd3ecf514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:36.159195 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78590-26c0-44a7-8133-9acd3ecf514d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.159521 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78590-26c0-44a7-8133-9acd3ecf514d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78590-26c0-44a7-8133-9acd3ecf514d None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.160462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac78590-26c0-44a7-8133-9acd3ecf514d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:36.160799 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac78590-26c0-44a7-8133-9acd3ecf514d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:36.162766 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac78590-26c0-44a7-8133-9acd3ecf514d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:36.176488 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 348/692] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:36.177098 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:36.178506 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78590-26c0-44a7-8133-9acd3ecf514d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:36.236134 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 345/693] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:36.238547 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c012e-9534-4447-ab18-b96079024689 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:36.250240 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:36.345405 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78590-26c0-44a7-8133-9acd3ecf514d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:36.410619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54332c-82ec-442f-97f5-3c4d20a29dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:36.411348 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54332c-82ec-442f-97f5-3c4d20a29dcc None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.411623 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54332c-82ec-442f-97f5-3c4d20a29dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.411888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54332c-82ec-442f-97f5-3c4d20a29dcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.425170 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54332c-82ec-442f-97f5-3c4d20a29dcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:36.426894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54332c-82ec-442f-97f5-3c4d20a29dcc None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:36.440566 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c012e-9534-4447-ab18-b96079024689 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-bb54332c-82ec-442f-97f5-3c4d20a29dcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:36.456523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:36.458670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:36.460930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:36.460930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:36.460930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:36.460930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:36.460930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:36.460930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:36.460930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:36.460930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:36.460930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 349/694] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:36.468063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54332c-82ec-442f-97f5-3c4d20a29dcc None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:36.495216 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3df76-df80-447b-8de7-6bbc2221b581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:36.495752 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3df76-df80-447b-8de7-6bbc2221b581 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.496027 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3df76-df80-447b-8de7-6bbc2221b581 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.496319 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3df76-df80-447b-8de7-6bbc2221b581 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.496964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3df76-df80-447b-8de7-6bbc2221b581 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:36.498530 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3df76-df80-447b-8de7-6bbc2221b581 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:36.523041 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 346/695] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:43:36 2022] POST /identity/v3/users => generated 254 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:36.554689 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3df76-df80-447b-8de7-6bbc2221b581 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:36.585798 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:36.615936 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54332c-82ec-442f-97f5-3c4d20a29dcc None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:36.646088 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:36.670791 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f37de-e157-46c8-b7e7-345fe97ef139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:36.671432 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f37de-e157-46c8-b7e7-345fe97ef139 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.671708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f37de-e157-46c8-b7e7-345fe97ef139 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.671977 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f37de-e157-46c8-b7e7-345fe97ef139 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.672842 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f37de-e157-46c8-b7e7-345fe97ef139 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:36.673142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f37de-e157-46c8-b7e7-345fe97ef139 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:36.674604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f37de-e157-46c8-b7e7-345fe97ef139 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:36.704639 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 350/696] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:36.708351 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f37de-e157-46c8-b7e7-345fe97ef139 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:36.741501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3df76-df80-447b-8de7-6bbc2221b581 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:36.783341 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f650f-068e-4ccc-b680-64ffe4724ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:36.783927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f650f-068e-4ccc-b680-64ffe4724ffc None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.784220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f650f-068e-4ccc-b680-64ffe4724ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.784487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f650f-068e-4ccc-b680-64ffe4724ffc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.797271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f650f-068e-4ccc-b680-64ffe4724ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-022f650f-068e-4ccc-b680-64ffe4724ffc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:36.803419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:36.804431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:36.805326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 347/697] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:36.811541 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f650f-068e-4ccc-b680-64ffe4724ffc None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:36.831296 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f37de-e157-46c8-b7e7-345fe97ef139 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:36.870132 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d5894-c130-490d-a85e-4aedc9eb8fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:36.871089 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d5894-c130-490d-a85e-4aedc9eb8fee None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.871541 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d5894-c130-490d-a85e-4aedc9eb8fee None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.871983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d5894-c130-490d-a85e-4aedc9eb8fee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.872995 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d5894-c130-490d-a85e-4aedc9eb8fee None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=cbc22a3976aa47cfb4367b0a433742ea) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:36.873484 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d5894-c130-490d-a85e-4aedc9eb8fee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:36.875089 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d5894-c130-490d-a85e-4aedc9eb8fee None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:36.884623 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 351/698] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:36 2022] GET /identity/v3/role_assignments?user.id=cbc22a3976aa47cfb4367b0a433742ea&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:36.896665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:36.932904 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f650f-068e-4ccc-b680-64ffe4724ffc None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:36.976340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221b23b-41ae-495f-9ab0-6adb113a5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:36.977317 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221b23b-41ae-495f-9ab0-6adb113a5c2c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.977770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221b23b-41ae-495f-9ab0-6adb113a5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.978273 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221b23b-41ae-495f-9ab0-6adb113a5c2c None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.979186 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221b23b-41ae-495f-9ab0-6adb113a5c2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:36.979681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221b23b-41ae-495f-9ab0-6adb113a5c2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:36.981305 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221b23b-41ae-495f-9ab0-6adb113a5c2c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:36.993373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 348/699] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:36.999695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d5894-c130-490d-a85e-4aedc9eb8fee None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.041865 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:37.133057 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d5894-c130-490d-a85e-4aedc9eb8fee None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.174529 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16aec2b-6341-4cc8-9952-e30891d72e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.175163 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aec2b-6341-4cc8-9952-e30891d72e8f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.175432 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aec2b-6341-4cc8-9952-e30891d72e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.175696 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aec2b-6341-4cc8-9952-e30891d72e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.186920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16aec2b-6341-4cc8-9952-e30891d72e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:37.188378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16aec2b-6341-4cc8-9952-e30891d72e8f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-c16aec2b-6341-4cc8-9952-e30891d72e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:37.202682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:37.203736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:37.204754 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:37.204754 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:37.204754 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:37.204754 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 352/700] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:37.210957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221b23b-41ae-495f-9ab0-6adb113a5c2c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.263793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d5fbf-324c-4078-b5d7-37305cb0bcd2 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.264348 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d5fbf-324c-4078-b5d7-37305cb0bcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.264426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d5fbf-324c-4078-b5d7-37305cb0bcd2 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.265974 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 353/701] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:37.271107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca1357-eee7-435e-96b1-635c56a7c379 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.271378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca1357-eee7-435e-96b1-635c56a7c379 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.271635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca1357-eee7-435e-96b1-635c56a7c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.290803 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-e0ca1357-eee7-435e-96b1-635c56a7c379 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:37.292215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e0ca1357-eee7-435e-96b1-635c56a7c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:37.348255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221b23b-41ae-495f-9ab0-6adb113a5c2c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.380815 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 354/702] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:43:37.391601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74693c-82b4-4c35-a2d7-56a463839db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.392477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74693c-82b4-4c35-a2d7-56a463839db1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.392930 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74693c-82b4-4c35-a2d7-56a463839db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.393396 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74693c-82b4-4c35-a2d7-56a463839db1 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.394203 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74693c-82b4-4c35-a2d7-56a463839db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:37.394728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74693c-82b4-4c35-a2d7-56a463839db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:37.396354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74693c-82b4-4c35-a2d7-56a463839db1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:37.398244 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:37.411003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 349/703] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:37.417044 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca1357-eee7-435e-96b1-635c56a7c379 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.433001 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:37.528786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca1357-eee7-435e-96b1-635c56a7c379 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.572869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b8d03-a6d3-4297-b6f2-1101b7b29d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.573826 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8d03-a6d3-4297-b6f2-1101b7b29d1c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.574298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8d03-a6d3-4297-b6f2-1101b7b29d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.574737 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8d03-a6d3-4297-b6f2-1101b7b29d1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.582994 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b8d03-a6d3-4297-b6f2-1101b7b29d1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:37.584864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b8d03-a6d3-4297-b6f2-1101b7b29d1c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-709b8d03-a6d3-4297-b6f2-1101b7b29d1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:37.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:37.600921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:37.601902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:37.601902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:37.601902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:37.601902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:37.601902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:37.601902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:37.601902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:37.601902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:37.601902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:37.601902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:37.604137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 355/704] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Oct 9 00:43:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:37.609956 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74693c-82b4-4c35-a2d7-56a463839db1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.735881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74693c-82b4-4c35-a2d7-56a463839db1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.770923 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228986ba-e659-4af3-b7f4-c81e386c78b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.771528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228986ba-e659-4af3-b7f4-c81e386c78b4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.771797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228986ba-e659-4af3-b7f4-c81e386c78b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.772074 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228986ba-e659-4af3-b7f4-c81e386c78b4 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.772790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228986ba-e659-4af3-b7f4-c81e386c78b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:37.773082 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228986ba-e659-4af3-b7f4-c81e386c78b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:37.774503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228986ba-e659-4af3-b7f4-c81e386c78b4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:37.799368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 350/705] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Oct 9 00:43:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:37.804989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b8d03-a6d3-4297-b6f2-1101b7b29d1c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.835368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228986ba-e659-4af3-b7f4-c81e386c78b4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.912426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:37.923699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b8d03-a6d3-4297-b6f2-1101b7b29d1c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.960460 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:37.968576 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c195967-32e5-4fd2-80de-d735bc9593f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.969135 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c195967-32e5-4fd2-80de-d735bc9593f8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.969407 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c195967-32e5-4fd2-80de-d735bc9593f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.969676 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c195967-32e5-4fd2-80de-d735bc9593f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.017953 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228986ba-e659-4af3-b7f4-c81e386c78b4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.054579 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259f03a-6746-46da-9423-423f89b4f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.055224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259f03a-6746-46da-9423-423f89b4f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.055504 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259f03a-6746-46da-9423-423f89b4f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.055775 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259f03a-6746-46da-9423-423f89b4f7c1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.056388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259f03a-6746-46da-9423-423f89b4f7c1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.057926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259f03a-6746-46da-9423-423f89b4f7c1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-f259f03a-6746-46da-9423-423f89b4f7c1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:38.069224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:38.070322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:38.071195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 351/706] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:37 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:38.076359 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259f03a-6746-46da-9423-423f89b4f7c1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.121422 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c195967-32e5-4fd2-80de-d735bc9593f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.122779 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c195967-32e5-4fd2-80de-d735bc9593f8 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.200019 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259f03a-6746-46da-9423-423f89b4f7c1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.202058 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:38.221860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:38.236982 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 356/707] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:38.238349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb4b0-b508-40b4-b2df-db1363fc0ce6 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.238633 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb4b0-b508-40b4-b2df-db1363fc0ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.238910 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb4b0-b508-40b4-b2df-db1363fc0ce6 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.244769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 357/708] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:38.245556 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12eb4b0-b508-40b4-b2df-db1363fc0ce6 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.245743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573847-6d7e-4d38-ac76-33709fe801fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.246601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573847-6d7e-4d38-ac76-33709fe801fa None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.247057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573847-6d7e-4d38-ac76-33709fe801fa None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.247491 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573847-6d7e-4d38-ac76-33709fe801fa None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.248606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573847-6d7e-4d38-ac76-33709fe801fa None admin] RBAC: Adding query filter params (name=network) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:38.249079 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573847-6d7e-4d38-ac76-33709fe801fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.251540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573847-6d7e-4d38-ac76-33709fe801fa None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.258450 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 352/709] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:38.263395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acdea7-cdc8-4b71-9788-0b274e9e9037 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.263395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acdea7-cdc8-4b71-9788-0b274e9e9037 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.263395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acdea7-cdc8-4b71-9788-0b274e9e9037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.289050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-99acdea7-cdc8-4b71-9788-0b274e9e9037 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:38.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-99acdea7-cdc8-4b71-9788-0b274e9e9037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:38.359682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12eb4b0-b508-40b4-b2df-db1363fc0ce6 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.387687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 353/710] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:38.388852 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acdea7-cdc8-4b71-9788-0b274e9e9037 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.410191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544467e-b8d2-4786-9c24-ae60928b597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.411031 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544467e-b8d2-4786-9c24-ae60928b597a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.411515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544467e-b8d2-4786-9c24-ae60928b597a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.412016 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544467e-b8d2-4786-9c24-ae60928b597a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.431907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544467e-b8d2-4786-9c24-ae60928b597a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.433540 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544467e-b8d2-4786-9c24-ae60928b597a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-7544467e-b8d2-4786-9c24-ae60928b597a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:38.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:38.461707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:38.462635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:38.462635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:38.462635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:38.473318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 358/711] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:38.474336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544467e-b8d2-4786-9c24-ae60928b597a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.503719 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acdea7-cdc8-4b71-9788-0b274e9e9037 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.516799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:38.537864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:38.548132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baab0-a13b-43eb-84fa-30e59c9fa102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.549047 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baab0-a13b-43eb-84fa-30e59c9fa102 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.549540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baab0-a13b-43eb-84fa-30e59c9fa102 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.550004 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789baab0-a13b-43eb-84fa-30e59c9fa102 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.550833 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789baab0-a13b-43eb-84fa-30e59c9fa102 None admin] RBAC: Adding query filter params (type=network) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:38.551328 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789baab0-a13b-43eb-84fa-30e59c9fa102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.553554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789baab0-a13b-43eb-84fa-30e59c9fa102 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.565370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 354/712] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:38.647289 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544467e-b8d2-4786-9c24-ae60928b597a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.684669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a278b-7d84-4856-8bc0-c6f67260b448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.685692 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a278b-7d84-4856-8bc0-c6f67260b448 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.686166 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a278b-7d84-4856-8bc0-c6f67260b448 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.686629 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a278b-7d84-4856-8bc0-c6f67260b448 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.687461 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a278b-7d84-4856-8bc0-c6f67260b448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:38.687976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a278b-7d84-4856-8bc0-c6f67260b448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.689574 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a278b-7d84-4856-8bc0-c6f67260b448 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.703605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 359/713] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:38.709085 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baab0-a13b-43eb-84fa-30e59c9fa102 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.753870 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a278b-7d84-4856-8bc0-c6f67260b448 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.827983 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789baab0-a13b-43eb-84fa-30e59c9fa102 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.865762 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85e73-8968-4772-9e54-6fdd7f55dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.866677 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85e73-8968-4772-9e54-6fdd7f55dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.866957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85e73-8968-4772-9e54-6fdd7f55dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.867228 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85e73-8968-4772-9e54-6fdd7f55dbb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.868636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:38.885024 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85e73-8968-4772-9e54-6fdd7f55dbb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.886529 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85e73-8968-4772-9e54-6fdd7f55dbb9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.905215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a278b-7d84-4856-8bc0-c6f67260b448 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-fef85e73-8968-4772-9e54-6fdd7f55dbb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:38.912959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:38.913974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:38.914908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:38.914908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:38.914908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:38.914908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:38.914908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:38.914908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:38.914908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:38.914908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:38.914908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 355/714] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:38.940954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85e73-8968-4772-9e54-6fdd7f55dbb9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.952228 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cdbe-f6b1-47d1-a924-43f72b8846a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.952872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cdbe-f6b1-47d1-a924-43f72b8846a4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.953145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cdbe-f6b1-47d1-a924-43f72b8846a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.953413 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cdbe-f6b1-47d1-a924-43f72b8846a4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.954047 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2cdbe-f6b1-47d1-a924-43f72b8846a4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.955422 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2cdbe-f6b1-47d1-a924-43f72b8846a4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-c2e2cdbe-f6b1-47d1-a924-43f72b8846a4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:38.967242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:38.969699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:38.971698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:38.976067 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 360/715] 10.222.0.43 () {56 vars in 1129 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:38.976067 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cdbe-f6b1-47d1-a924-43f72b8846a4 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:39.043627 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:39.088201 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cdbe-f6b1-47d1-a924-43f72b8846a4 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:39.129709 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2207fa0-892e-4ec9-be6d-1f96406a32c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:39.130584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2207fa0-892e-4ec9-be6d-1f96406a32c3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.130952 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2207fa0-892e-4ec9-be6d-1f96406a32c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.131223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2207fa0-892e-4ec9-be6d-1f96406a32c3 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.132192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2207fa0-892e-4ec9-be6d-1f96406a32c3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:39.132490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2207fa0-892e-4ec9-be6d-1f96406a32c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:39.133876 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2207fa0-892e-4ec9-be6d-1f96406a32c3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:39.151642 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 361/716] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:39.153811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2207fa0-892e-4ec9-be6d-1f96406a32c3 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:39.183922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85e73-8968-4772-9e54-6fdd7f55dbb9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:39.184282 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:39.233502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b691f-6d91-47dc-bf20-3fd7d344ef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:39.234183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b691f-6d91-47dc-bf20-3fd7d344ef23 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.234388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b691f-6d91-47dc-bf20-3fd7d344ef23 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.234664 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b691f-6d91-47dc-bf20-3fd7d344ef23 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.235456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b691f-6d91-47dc-bf20-3fd7d344ef23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:39.235761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b691f-6d91-47dc-bf20-3fd7d344ef23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:39.238048 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b691f-6d91-47dc-bf20-3fd7d344ef23 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:39.256068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 356/717] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:39.256068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8b46f-eff9-479c-be43-a523f6c1450f None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.256068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8b46f-eff9-479c-be43-a523f6c1450f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.256068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8b46f-eff9-479c-be43-a523f6c1450f None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.256068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 357/718] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:39.261367 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8b46f-eff9-479c-be43-a523f6c1450f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:39.299197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2207fa0-892e-4ec9-be6d-1f96406a32c3 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:39.340492 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003f233-0459-4a18-85a7-1150669a06f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:39.341157 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003f233-0459-4a18-85a7-1150669a06f3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.341436 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003f233-0459-4a18-85a7-1150669a06f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.341704 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003f233-0459-4a18-85a7-1150669a06f3 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.342385 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003f233-0459-4a18-85a7-1150669a06f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:39.342933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003f233-0459-4a18-85a7-1150669a06f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:39.345937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003f233-0459-4a18-85a7-1150669a06f3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:39.356139 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 362/719] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Oct 9 00:43:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:39.357419 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341297-d0f7-492d-a0e9-8fb38b05f28b None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.357691 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341297-d0f7-492d-a0e9-8fb38b05f28b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.357952 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341297-d0f7-492d-a0e9-8fb38b05f28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.393663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-9c341297-d0f7-492d-a0e9-8fb38b05f28b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:39.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-9c341297-d0f7-492d-a0e9-8fb38b05f28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:39.402763 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:39.411961 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8b46f-eff9-479c-be43-a523f6c1450f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:39.476823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edecdf-4e69-44f8-95b7-4818420fb004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:39.477917 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edecdf-4e69-44f8-95b7-4818420fb004 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.478681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edecdf-4e69-44f8-95b7-4818420fb004 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.479100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edecdf-4e69-44f8-95b7-4818420fb004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.480110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edecdf-4e69-44f8-95b7-4818420fb004 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=f960fdabbffa4813a0ea46bb82218f09) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:39.480671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edecdf-4e69-44f8-95b7-4818420fb004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:39.482393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edecdf-4e69-44f8-95b7-4818420fb004 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:39.496374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 358/720] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:39 2022] GET /identity/v3/role_assignments?user.id=f960fdabbffa4813a0ea46bb82218f09&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:39.526717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 363/721] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:39.832327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edecdf-4e69-44f8-95b7-4818420fb004 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:39.850112 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddd9c1-6e80-4843-9dfc-a28e9d0213dd None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.850413 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddd9c1-6e80-4843-9dfc-a28e9d0213dd None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.850650 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddd9c1-6e80-4843-9dfc-a28e9d0213dd None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.853879 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 364/722] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:39.874528 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7173556-8279-46dc-8364-7a650ba174d2 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.874848 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7173556-8279-46dc-8364-7a650ba174d2 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.875056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7173556-8279-46dc-8364-7a650ba174d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.901210 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-f7173556-8279-46dc-8364-7a650ba174d2 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:39.902397 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-f7173556-8279-46dc-8364-7a650ba174d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:39.904553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:39.999699 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edecdf-4e69-44f8-95b7-4818420fb004 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:40.026099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 365/723] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:40.045760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08066b-a728-4d6d-aadc-d737de76f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:40.046309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08066b-a728-4d6d-aadc-d737de76f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:40.046582 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08066b-a728-4d6d-aadc-d737de76f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:40.046849 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08066b-a728-4d6d-aadc-d737de76f3b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:40.057525 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08066b-a728-4d6d-aadc-d737de76f3b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-de08066b-a728-4d6d-aadc-d737de76f3b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:40.062865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:40.063845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:40.064759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 359/724] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:40.070249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7173556-8279-46dc-8364-7a650ba174d2 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:40.199873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7173556-8279-46dc-8364-7a650ba174d2 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:40.243395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748c254-3aa8-4f75-81e5-d0cd59bb388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:40.244002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748c254-3aa8-4f75-81e5-d0cd59bb388f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:40.244322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748c254-3aa8-4f75-81e5-d0cd59bb388f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:40.244586 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748c254-3aa8-4f75-81e5-d0cd59bb388f None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:40.245245 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748c254-3aa8-4f75-81e5-d0cd59bb388f None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:40.245536 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748c254-3aa8-4f75-81e5-d0cd59bb388f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:40.246880 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748c254-3aa8-4f75-81e5-d0cd59bb388f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:40.252154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:40.259740 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 366/725] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:40.265270 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08066b-a728-4d6d-aadc-d737de76f3b2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:40.303290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:40.360873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748c254-3aa8-4f75-81e5-d0cd59bb388f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:40.405828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08066b-a728-4d6d-aadc-d737de76f3b2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:40.444105 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a93a51-e9be-44c8-87dc-d6b93c3c238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:40.444834 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a93a51-e9be-44c8-87dc-d6b93c3c238d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:40.445303 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a93a51-e9be-44c8-87dc-d6b93c3c238d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:40.445581 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a93a51-e9be-44c8-87dc-d6b93c3c238d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:40.456831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a93a51-e9be-44c8-87dc-d6b93c3c238d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:40.458373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a93a51-e9be-44c8-87dc-d6b93c3c238d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b2a93a51-e9be-44c8-87dc-d6b93c3c238d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:40.476517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:40.478708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:40.480856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:40.480856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:40.480856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:40.480856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 360/726] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:40.484901 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a93a51-e9be-44c8-87dc-d6b93c3c238d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:40.587248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:40.595027 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748c254-3aa8-4f75-81e5-d0cd59bb388f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:40.627790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a93a51-e9be-44c8-87dc-d6b93c3c238d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:40.665102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48f3e6-bee0-430d-bd0f-930ebb460612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:40.665737 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48f3e6-bee0-430d-bd0f-930ebb460612 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:40.666008 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48f3e6-bee0-430d-bd0f-930ebb460612 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:40.666272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48f3e6-bee0-430d-bd0f-930ebb460612 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:40.687462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48f3e6-bee0-430d-bd0f-930ebb460612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-6c48f3e6-bee0-430d-bd0f-930ebb460612 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:40.693142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:40.694177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:40.695693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 367/727] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:40.699933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48f3e6-bee0-430d-bd0f-930ebb460612 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:40.713043 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a9a07-edb2-4bf0-9c26-9fd1fb10b428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:40.713665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a9a07-edb2-4bf0-9c26-9fd1fb10b428 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:40.713934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a9a07-edb2-4bf0-9c26-9fd1fb10b428 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:40.714202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a9a07-edb2-4bf0-9c26-9fd1fb10b428 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:40.714840 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a9a07-edb2-4bf0-9c26-9fd1fb10b428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:40.715135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a9a07-edb2-4bf0-9c26-9fd1fb10b428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:40.716578 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a9a07-edb2-4bf0-9c26-9fd1fb10b428 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:40.747343 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 361/728] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:40.752878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a9a07-edb2-4bf0-9c26-9fd1fb10b428 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:40.780403 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:40.845786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48f3e6-bee0-430d-bd0f-930ebb460612 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:40.883447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd606396-5853-41b3-b33e-0061b37da7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:40.884099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd606396-5853-41b3-b33e-0061b37da7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:40.884378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd606396-5853-41b3-b33e-0061b37da7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:40.884646 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd606396-5853-41b3-b33e-0061b37da7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:40.885301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd606396-5853-41b3-b33e-0061b37da7c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:40.885596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd606396-5853-41b3-b33e-0061b37da7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:40.887074 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd606396-5853-41b3-b33e-0061b37da7c5 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:40.895879 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 368/729] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:40.901705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd606396-5853-41b3-b33e-0061b37da7c5 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:40.955971 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a9a07-edb2-4bf0-9c26-9fd1fb10b428 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.006502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd606396-5853-41b3-b33e-0061b37da7c5 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.010563 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.023593 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33e2d3-4421-4ddf-8e8c-a8a05629b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.024273 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33e2d3-4421-4ddf-8e8c-a8a05629b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.024552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33e2d3-4421-4ddf-8e8c-a8a05629b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.024821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33e2d3-4421-4ddf-8e8c-a8a05629b5f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.032062 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.044346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430d826-32c3-49aa-a4b7-1ffd73798064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.044812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33e2d3-4421-4ddf-8e8c-a8a05629b5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.045116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430d826-32c3-49aa-a4b7-1ffd73798064 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.045458 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430d826-32c3-49aa-a4b7-1ffd73798064 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.045793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430d826-32c3-49aa-a4b7-1ffd73798064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.046302 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33e2d3-4421-4ddf-8e8c-a8a05629b5f1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.057135 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430d826-32c3-49aa-a4b7-1ffd73798064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.058674 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430d826-32c3-49aa-a4b7-1ffd73798064 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0d33e2d3-4421-4ddf-8e8c-a8a05629b5f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:41.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:41.066661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:41.067886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:41.067886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:41.067886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:41.067886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:41.067886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:41.067886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:41.067886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:41.067886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:41.067886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:41.067886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:41.067886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 362/730] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Oct 9 00:43:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:41.072627 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33e2d3-4421-4ddf-8e8c-a8a05629b5f1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-1430d826-32c3-49aa-a4b7-1ffd73798064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:41.073962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:41.074883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:41.076872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:41.076872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:41.076872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:41.076872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 369/731] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:41.080792 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430d826-32c3-49aa-a4b7-1ffd73798064 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.203896 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430d826-32c3-49aa-a4b7-1ffd73798064 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.269091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33e2d3-4421-4ddf-8e8c-a8a05629b5f1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.272416 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85eb18-db18-46dc-99d2-5dd8093a4ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.273031 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85eb18-db18-46dc-99d2-5dd8093a4ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.273302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85eb18-db18-46dc-99d2-5dd8093a4ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.273562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85eb18-db18-46dc-99d2-5dd8093a4ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.274192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85eb18-db18-46dc-99d2-5dd8093a4ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:41.274486 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85eb18-db18-46dc-99d2-5dd8093a4ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.275863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85eb18-db18-46dc-99d2-5dd8093a4ab4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.299220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 370/732] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:41.305404 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85eb18-db18-46dc-99d2-5dd8093a4ab4 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.337076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c6d1c-4e86-45c5-95e5-c0f8141d9463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.337744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c6d1c-4e86-45c5-95e5-c0f8141d9463 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.338018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c6d1c-4e86-45c5-95e5-c0f8141d9463 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.338278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c6d1c-4e86-45c5-95e5-c0f8141d9463 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.339058 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c6d1c-4e86-45c5-95e5-c0f8141d9463 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:41.339358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c6d1c-4e86-45c5-95e5-c0f8141d9463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.340830 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c6d1c-4e86-45c5-95e5-c0f8141d9463 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.362305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.369716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 363/733] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:41.370970 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b14f0-f800-4ab2-a9a1-3ef04952f008 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.371250 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b14f0-f800-4ab2-a9a1-3ef04952f008 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.371521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b14f0-f800-4ab2-a9a1-3ef04952f008 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.377449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 364/734] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:41.378232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b14f0-f800-4ab2-a9a1-3ef04952f008 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.428402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85eb18-db18-46dc-99d2-5dd8093a4ab4 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.449517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.467827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d51581-2c96-452b-b6f2-bdb770c99e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.468501 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51581-2c96-452b-b6f2-bdb770c99e7f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.468769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51581-2c96-452b-b6f2-bdb770c99e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.469033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51581-2c96-452b-b6f2-bdb770c99e7f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.477124 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d51581-2c96-452b-b6f2-bdb770c99e7f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.478517 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d51581-2c96-452b-b6f2-bdb770c99e7f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-b9d51581-2c96-452b-b6f2-bdb770c99e7f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:41.491222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:41.492313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:41.493299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:41.493299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:41.493299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:41.493299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:41.493299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:41.493299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:41.493299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:41.493299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:41.493299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:41.493299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:41.496316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 371/735] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:41.497737 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439a8ee-f227-4ab6-ac74-b1c1057b2a4c None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.498019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439a8ee-f227-4ab6-ac74-b1c1057b2a4c None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.498287 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439a8ee-f227-4ab6-ac74-b1c1057b2a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.509143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b14f0-f800-4ab2-a9a1-3ef04952f008 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.521397 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-4439a8ee-f227-4ab6-ac74-b1c1057b2a4c None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:41.522693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-4439a8ee-f227-4ab6-ac74-b1c1057b2a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:41.557890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5c37c-1f74-4642-aef3-0c42f6ff6069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.558887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5c37c-1f74-4642-aef3-0c42f6ff6069 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.559360 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5c37c-1f74-4642-aef3-0c42f6ff6069 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.560156 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5c37c-1f74-4642-aef3-0c42f6ff6069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.600392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 372/736] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:41.601486 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439a8ee-f227-4ab6-ac74-b1c1057b2a4c None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.645153 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5c37c-1f74-4642-aef3-0c42f6ff6069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.647156 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5c37c-1f74-4642-aef3-0c42f6ff6069 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.649503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.705321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.760230 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 365/737] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:41.765194 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5c37c-1f74-4642-aef3-0c42f6ff6069 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.815330 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439a8ee-f227-4ab6-ac74-b1c1057b2a4c None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5c37c-1f74-4642-aef3-0c42f6ff6069 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.913792 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcb628-e808-4a07-a86b-2542641c8d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.914424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcb628-e808-4a07-a86b-2542641c8d3c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.914698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcb628-e808-4a07-a86b-2542641c8d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.915039 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcb628-e808-4a07-a86b-2542641c8d3c None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.915686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcb628-e808-4a07-a86b-2542641c8d3c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:41.915983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcb628-e808-4a07-a86b-2542641c8d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.917422 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcb628-e808-4a07-a86b-2542641c8d3c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.929159 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78edf59-834c-440f-9f82-3caf35d34130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.929807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78edf59-834c-440f-9f82-3caf35d34130 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.930101 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78edf59-834c-440f-9f82-3caf35d34130 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.930364 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78edf59-834c-440f-9f82-3caf35d34130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78edf59-834c-440f-9f82-3caf35d34130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.945220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 373/738] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:41.945641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78edf59-834c-440f-9f82-3caf35d34130 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.946787 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d3e51-6e85-4ef8-96af-cd941189a89c None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.947074 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d3e51-6e85-4ef8-96af-cd941189a89c None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.947348 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d3e51-6e85-4ef8-96af-cd941189a89c None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.948839 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 374/739] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:41.953540 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d3e51-6e85-4ef8-96af-cd941189a89c None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.955336 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-d78edf59-834c-440f-9f82-3caf35d34130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:41.963093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:41.964122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:41.965066 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:41.965066 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:41.965066 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:41.965066 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 366/740] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:41.965743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b892-78c1-4ef9-ab95-f52103310998 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.965944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b892-78c1-4ef9-ab95-f52103310998 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.966850 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512b892-78c1-4ef9-ab95-f52103310998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.989902 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a512b892-78c1-4ef9-ab95-f52103310998 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:41.991167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a512b892-78c1-4ef9-ab95-f52103310998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:42.044638 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.058694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 367/741] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:42.059826 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512b892-78c1-4ef9-ab95-f52103310998 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.072619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d3e51-6e85-4ef8-96af-cd941189a89c None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.107989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40766e1a-efbb-4fba-a369-1f69714530fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.108615 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40766e1a-efbb-4fba-a369-1f69714530fd None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.108889 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40766e1a-efbb-4fba-a369-1f69714530fd None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.109154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40766e1a-efbb-4fba-a369-1f69714530fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.161072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512b892-78c1-4ef9-ab95-f52103310998 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.175228 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40766e1a-efbb-4fba-a369-1f69714530fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.176780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40766e1a-efbb-4fba-a369-1f69714530fd None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.189347 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.196146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a10cd2-00e3-48c5-8661-5cd2333e600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.196759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10cd2-00e3-48c5-8661-5cd2333e600d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.197037 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10cd2-00e3-48c5-8661-5cd2333e600d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.197311 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10cd2-00e3-48c5-8661-5cd2333e600d None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.197946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a10cd2-00e3-48c5-8661-5cd2333e600d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:42.198245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a10cd2-00e3-48c5-8661-5cd2333e600d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.199633 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a10cd2-00e3-48c5-8661-5cd2333e600d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.215531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 368/742] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:42.215531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5836933-c5b7-4e63-b607-b72e85c13b49 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.215531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5836933-c5b7-4e63-b607-b72e85c13b49 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.215531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5836933-c5b7-4e63-b607-b72e85c13b49 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.218333 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 369/743] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:42.219105 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5836933-c5b7-4e63-b607-b72e85c13b49 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.263576 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.285161 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 375/744] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:43:42.285865 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40766e1a-efbb-4fba-a369-1f69714530fd None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.331729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5836933-c5b7-4e63-b607-b72e85c13b49 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.365073 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2a6a9-4231-46ba-ad3a-65ddcc79c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.365674 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a6a9-4231-46ba-ad3a-65ddcc79c519 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.365956 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a6a9-4231-46ba-ad3a-65ddcc79c519 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.366408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a6a9-4231-46ba-ad3a-65ddcc79c519 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2a6a9-4231-46ba-ad3a-65ddcc79c519 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.368476 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2a6a9-4231-46ba-ad3a-65ddcc79c519 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.385086 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 370/745] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:43:42 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:42.386540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1778f-e7f5-4c6c-87aa-b96c8d36c9a5 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.386999 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1778f-e7f5-4c6c-87aa-b96c8d36c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.387475 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1778f-e7f5-4c6c-87aa-b96c8d36c9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.388166 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40766e1a-efbb-4fba-a369-1f69714530fd None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.444645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aed0e1-d5ac-47a7-89bb-aa060a9826c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.445330 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed0e1-d5ac-47a7-89bb-aa060a9826c9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.445604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed0e1-d5ac-47a7-89bb-aa060a9826c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.445872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed0e1-d5ac-47a7-89bb-aa060a9826c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.454849 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aed0e1-d5ac-47a7-89bb-aa060a9826c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.456408 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aed0e1-d5ac-47a7-89bb-aa060a9826c9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-44aed0e1-d5ac-47a7-89bb-aa060a9826c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:42.468950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:42.469973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:42.470933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:42.470933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:42.470933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:42.470933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:42.470933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:42.470933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:42.470933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:42.470933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:42.470933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 376/746] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:42.471434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aed0e1-d5ac-47a7-89bb-aa060a9826c9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.521000 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.528415 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-fca1778f-e7f5-4c6c-87aa-b96c8d36c9a5 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:42.529706 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fca1778f-e7f5-4c6c-87aa-b96c8d36c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:42.586358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.587920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aed0e1-d5ac-47a7-89bb-aa060a9826c9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.614612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 371/747] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:42 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:43:42.615810 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1778f-e7f5-4c6c-87aa-b96c8d36c9a5 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.626981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65667c4e-a26f-4e28-b2e2-92028cb303b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.628435 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65667c4e-a26f-4e28-b2e2-92028cb303b5 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.628906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65667c4e-a26f-4e28-b2e2-92028cb303b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.629551 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65667c4e-a26f-4e28-b2e2-92028cb303b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.641515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65667c4e-a26f-4e28-b2e2-92028cb303b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.643409 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65667c4e-a26f-4e28-b2e2-92028cb303b5 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-65667c4e-a26f-4e28-b2e2-92028cb303b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:42.658886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:42.659894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:42.660844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:42.660844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:42.660844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:42.663073 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 377/748] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:42.664065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65667c4e-a26f-4e28-b2e2-92028cb303b5 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.726442 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1778f-e7f5-4c6c-87aa-b96c8d36c9a5 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.759421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.764228 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8719de3-5373-478f-ad25-d394f301b755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.764940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719de3-5373-478f-ad25-d394f301b755 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.765319 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719de3-5373-478f-ad25-d394f301b755 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.765891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719de3-5373-478f-ad25-d394f301b755 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.770148 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65667c4e-a26f-4e28-b2e2-92028cb303b5 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.783750 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8719de3-5373-478f-ad25-d394f301b755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a8719de3-5373-478f-ad25-d394f301b755 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:42.794214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:42.795189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:42.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 372/749] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:42.796854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8719de3-5373-478f-ad25-d394f301b755 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.814643 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a2cc5-c430-45f2-943e-46ff4212d116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.815644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a2cc5-c430-45f2-943e-46ff4212d116 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.816224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a2cc5-c430-45f2-943e-46ff4212d116 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.816688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a2cc5-c430-45f2-943e-46ff4212d116 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.817763 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a2cc5-c430-45f2-943e-46ff4212d116 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:42.818276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a2cc5-c430-45f2-943e-46ff4212d116 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.819947 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a2cc5-c430-45f2-943e-46ff4212d116 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.833495 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 378/750] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:42.834627 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a2cc5-c430-45f2-943e-46ff4212d116 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.841965 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.904966 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8719de3-5373-478f-ad25-d394f301b755 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.940109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317b0ff-5c69-454f-be1d-793b4e27db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.940715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317b0ff-5c69-454f-be1d-793b4e27db74 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.940985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317b0ff-5c69-454f-be1d-793b4e27db74 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.941252 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317b0ff-5c69-454f-be1d-793b4e27db74 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.941877 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317b0ff-5c69-454f-be1d-793b4e27db74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:42.942168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317b0ff-5c69-454f-be1d-793b4e27db74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.943591 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317b0ff-5c69-454f-be1d-793b4e27db74 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.946419 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a2cc5-c430-45f2-943e-46ff4212d116 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.956406 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 373/751] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:42.956406 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317b0ff-5c69-454f-be1d-793b4e27db74 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.982883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce885ef-3ee1-4b69-9d26-601bfb0d983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.983483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce885ef-3ee1-4b69-9d26-601bfb0d983a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.983751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce885ef-3ee1-4b69-9d26-601bfb0d983a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.984012 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce885ef-3ee1-4b69-9d26-601bfb0d983a None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.984686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce885ef-3ee1-4b69-9d26-601bfb0d983a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:42.984983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce885ef-3ee1-4b69-9d26-601bfb0d983a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.986333 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce885ef-3ee1-4b69-9d26-601bfb0d983a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.995113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 379/752] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:43.000134 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce885ef-3ee1-4b69-9d26-601bfb0d983a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:43.015207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:43.058824 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:43.062317 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317b0ff-5c69-454f-be1d-793b4e27db74 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.099260 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaec57-bcdd-4e7d-8c25-4505d399e66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.099847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaec57-bcdd-4e7d-8c25-4505d399e66f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaec57-bcdd-4e7d-8c25-4505d399e66f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.100602 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaec57-bcdd-4e7d-8c25-4505d399e66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.101202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaec57-bcdd-4e7d-8c25-4505d399e66f None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=7b36a416960d4106935476ef2b1682f6) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:43.101432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaec57-bcdd-4e7d-8c25-4505d399e66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.102861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaec57-bcdd-4e7d-8c25-4505d399e66f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.103583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce885ef-3ee1-4b69-9d26-601bfb0d983a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.120094 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 374/753] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/role_assignments?user.id=7b36a416960d4106935476ef2b1682f6&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:43.120094 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaec57-bcdd-4e7d-8c25-4505d399e66f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:43.160280 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9dcc8-2af1-4256-991e-30fe7b9e979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.161452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9dcc8-2af1-4256-991e-30fe7b9e979e None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.161958 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9dcc8-2af1-4256-991e-30fe7b9e979e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.162470 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9dcc8-2af1-4256-991e-30fe7b9e979e None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.163617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9dcc8-2af1-4256-991e-30fe7b9e979e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.166076 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9dcc8-2af1-4256-991e-30fe7b9e979e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.191890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 380/754] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:43:42 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:43.193560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9dcc8-2af1-4256-991e-30fe7b9e979e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:43.294898 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaec57-bcdd-4e7d-8c25-4505d399e66f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.346141 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ae581-a6b4-44f2-8737-f1b2ab4aac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.346821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ae581-a6b4-44f2-8737-f1b2ab4aac6e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.347211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ae581-a6b4-44f2-8737-f1b2ab4aac6e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.347545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ae581-a6b4-44f2-8737-f1b2ab4aac6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.356646 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ae581-a6b4-44f2-8737-f1b2ab4aac6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.358449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ae581-a6b4-44f2-8737-f1b2ab4aac6e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-f41ae581-a6b4-44f2-8737-f1b2ab4aac6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:43.378293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:43.379298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:43.380416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:43.380416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:43.380416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:43.380416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:43.380416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:43.380416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:43.380416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:43.380416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:43.380416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 375/755] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:43.381254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:43.388158 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ae581-a6b4-44f2-8737-f1b2ab4aac6e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:43.428945 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9dcc8-2af1-4256-991e-30fe7b9e979e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.431245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:43.475063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a7642-553b-4690-8520-7cd9a8667ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.475814 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7642-553b-4690-8520-7cd9a8667ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.476131 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7642-553b-4690-8520-7cd9a8667ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.476403 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a7642-553b-4690-8520-7cd9a8667ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.493722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a7642-553b-4690-8520-7cd9a8667ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.495553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a7642-553b-4690-8520-7cd9a8667ad2 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-e69a7642-553b-4690-8520-7cd9a8667ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:43.514778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:43.515901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:43.517521 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:43.517521 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:43.517521 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:43.519640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 381/756] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:43.523453 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ae581-a6b4-44f2-8737-f1b2ab4aac6e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.525978 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a7642-553b-4690-8520-7cd9a8667ad2 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:43.564363 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d395-7b5e-466e-bde1-fa6eaa949ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.565473 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d395-7b5e-466e-bde1-fa6eaa949ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.566054 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d395-7b5e-466e-bde1-fa6eaa949ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.566524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d395-7b5e-466e-bde1-fa6eaa949ef8 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.567532 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1d395-7b5e-466e-bde1-fa6eaa949ef8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:43.568277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1d395-7b5e-466e-bde1-fa6eaa949ef8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.570139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1d395-7b5e-466e-bde1-fa6eaa949ef8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.584111 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 376/757] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:43.591097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d395-7b5e-466e-bde1-fa6eaa949ef8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:43.648205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a7642-553b-4690-8520-7cd9a8667ad2 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.685218 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:43.706726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:43.707661 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f69fe0-d320-4883-8fdf-546ab511b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.708495 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f69fe0-d320-4883-8fdf-546ab511b8aa None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.708934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f69fe0-d320-4883-8fdf-546ab511b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.709216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f69fe0-d320-4883-8fdf-546ab511b8aa None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.709860 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f69fe0-d320-4883-8fdf-546ab511b8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:43.711024 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f69fe0-d320-4883-8fdf-546ab511b8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.712265 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f69fe0-d320-4883-8fdf-546ab511b8aa None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.735185 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d395-7b5e-466e-bde1-fa6eaa949ef8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.739677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 382/758] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:43.747590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f69fe0-d320-4883-8fdf-546ab511b8aa None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:43.787279 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e28073-dd51-4051-a73a-effd6b2ed31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.788000 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28073-dd51-4051-a73a-effd6b2ed31a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.788427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28073-dd51-4051-a73a-effd6b2ed31a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.788704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28073-dd51-4051-a73a-effd6b2ed31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.789502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e28073-dd51-4051-a73a-effd6b2ed31a None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=cbc22a3976aa47cfb4367b0a433742ea) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:43.789800 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e28073-dd51-4051-a73a-effd6b2ed31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.791307 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e28073-dd51-4051-a73a-effd6b2ed31a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.805504 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 377/759] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:43 2022] GET /identity/v3/role_assignments?user.id=cbc22a3976aa47cfb4367b0a433742ea&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:43.886833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f69fe0-d320-4883-8fdf-546ab511b8aa None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.925081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4db25-60c9-4b9a-9ea4-8390a36e4c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.926106 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4db25-60c9-4b9a-9ea4-8390a36e4c4b None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.926606 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4db25-60c9-4b9a-9ea4-8390a36e4c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.927205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4db25-60c9-4b9a-9ea4-8390a36e4c4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.935996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4db25-60c9-4b9a-9ea4-8390a36e4c4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.937940 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4db25-60c9-4b9a-9ea4-8390a36e4c4b None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-2ae4db25-60c9-4b9a-9ea4-8390a36e4c4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:43.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:43.952981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:43.954059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:43.954059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:43.954059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:43.954059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:43.954059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:43.954059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:43.954059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:43.954059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:43.954059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:43.954059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:43.956815 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 383/760] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Oct 9 00:43:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:43.964164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e28073-dd51-4051-a73a-effd6b2ed31a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:44.107992 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e28073-dd51-4051-a73a-effd6b2ed31a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:44.152195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ae329-f3e2-4d85-a9ae-2d34c05baca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:44.152808 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ae329-f3e2-4d85-a9ae-2d34c05baca3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:44.153082 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ae329-f3e2-4d85-a9ae-2d34c05baca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:44.153353 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ae329-f3e2-4d85-a9ae-2d34c05baca3 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:44.154075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ae329-f3e2-4d85-a9ae-2d34c05baca3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:44.154430 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ae329-f3e2-4d85-a9ae-2d34c05baca3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:44.155926 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ae329-f3e2-4d85-a9ae-2d34c05baca3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:44.174676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 378/761] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Oct 9 00:43:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:44.180753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4db25-60c9-4b9a-9ea4-8390a36e4c4b None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:44.234168 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:44.304189 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4db25-60c9-4b9a-9ea4-8390a36e4c4b None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:44.344671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fe6f8-1ef2-412a-8626-7dd855e5c2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:44.345328 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fe6f8-1ef2-412a-8626-7dd855e5c2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:44.345604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fe6f8-1ef2-412a-8626-7dd855e5c2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:44.345874 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fe6f8-1ef2-412a-8626-7dd855e5c2b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:44.367989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fe6f8-1ef2-412a-8626-7dd855e5c2b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:44.369552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fe6f8-1ef2-412a-8626-7dd855e5c2b0 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-274fe6f8-1ef2-412a-8626-7dd855e5c2b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:44.388816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:44.389866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:44.391454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:44.391454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:44.391454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:44.391454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 384/762] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:44.396156 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ae329-f3e2-4d85-a9ae-2d34c05baca3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:44.399242 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:44.542001 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ae329-f3e2-4d85-a9ae-2d34c05baca3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:44.585890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deedb0-337a-43c6-9ae8-c999452798f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:44.586506 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deedb0-337a-43c6-9ae8-c999452798f1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:44.586776 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deedb0-337a-43c6-9ae8-c999452798f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:44.587045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deedb0-337a-43c6-9ae8-c999452798f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:44.587681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0deedb0-337a-43c6-9ae8-c999452798f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:44.587976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0deedb0-337a-43c6-9ae8-c999452798f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:44.589395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0deedb0-337a-43c6-9ae8-c999452798f1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:44.608829 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 379/763] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:44.614316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fe6f8-1ef2-412a-8626-7dd855e5c2b0 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:44.754360 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:44.762603 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fe6f8-1ef2-412a-8626-7dd855e5c2b0 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:44.825928 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc408268-a1db-4b3e-8fda-10ec0c26e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:44.826513 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc408268-a1db-4b3e-8fda-10ec0c26e476 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:44.826786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc408268-a1db-4b3e-8fda-10ec0c26e476 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:44.827056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc408268-a1db-4b3e-8fda-10ec0c26e476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:44.845484 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc408268-a1db-4b3e-8fda-10ec0c26e476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:44.846963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc408268-a1db-4b3e-8fda-10ec0c26e476 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-dc408268-a1db-4b3e-8fda-10ec0c26e476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:44.862243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:44.863215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:44.864850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:44.864850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:44.864850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:44.864850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:44.864850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:44.864850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:44.864850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:44.864850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:44.864850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 385/764] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:44.869412 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deedb0-337a-43c6-9ae8-c999452798f1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:44.943766 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce15038-343f-4aab-93a8-cf0e2e0f7713 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:44.944107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce15038-343f-4aab-93a8-cf0e2e0f7713 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:44.944326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce15038-343f-4aab-93a8-cf0e2e0f7713 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:44.945930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 386/765] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:44.950843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:44.951088 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e25fc-a4dd-44c7-8bed-5840f6adb627 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:44.951368 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e25fc-a4dd-44c7-8bed-5840f6adb627 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:44.951634 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e25fc-a4dd-44c7-8bed-5840f6adb627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:44.992800 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deedb0-337a-43c6-9ae8-c999452798f1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:44.997056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-3b0e25fc-a4dd-44c7-8bed-5840f6adb627 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:44.998267 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3b0e25fc-a4dd-44c7-8bed-5840f6adb627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:45.032254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c632482-1624-40d4-95ac-26ea3cc3e971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:45.034614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c632482-1624-40d4-95ac-26ea3cc3e971 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:45.035107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c632482-1624-40d4-95ac-26ea3cc3e971 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:45.035784 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c632482-1624-40d4-95ac-26ea3cc3e971 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:45.037772 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c632482-1624-40d4-95ac-26ea3cc3e971 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:45.038374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c632482-1624-40d4-95ac-26ea3cc3e971 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:45.041823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c632482-1624-40d4-95ac-26ea3cc3e971 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:45.056277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 380/766] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:45.062441 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c632482-1624-40d4-95ac-26ea3cc3e971 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:45.176083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 387/767] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:45.180840 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c632482-1624-40d4-95ac-26ea3cc3e971 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:45.217900 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:45.233402 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457c33-d988-41bb-bc58-037bfb615ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:45.234333 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457c33-d988-41bb-bc58-037bfb615ecd None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:45.234809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457c33-d988-41bb-bc58-037bfb615ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:45.235296 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457c33-d988-41bb-bc58-037bfb615ecd None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/f960fdabbffa4813a0ea46bb82218f09/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:45.237513 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457c33-d988-41bb-bc58-037bfb615ecd None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=f960fdabbffa4813a0ea46bb82218f09, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:45.239316 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457c33-d988-41bb-bc58-037bfb615ecd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:45.258305 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 381/768] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:45 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/f960fdabbffa4813a0ea46bb82218f09/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:43:45.461889 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e25fc-a4dd-44c7-8bed-5840f6adb627 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:45.560066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:45.575830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e25fc-a4dd-44c7-8bed-5840f6adb627 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:45.612985 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399eaa1-c11f-4e18-b3c5-f8d291d54ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:45.613676 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399eaa1-c11f-4e18-b3c5-f8d291d54ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:45.613957 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399eaa1-c11f-4e18-b3c5-f8d291d54ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:45.614261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399eaa1-c11f-4e18-b3c5-f8d291d54ec8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:45.615188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399eaa1-c11f-4e18-b3c5-f8d291d54ec8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:45.616590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399eaa1-c11f-4e18-b3c5-f8d291d54ec8 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-0399eaa1-c11f-4e18-b3c5-f8d291d54ec8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:45.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:45.626563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:45.627424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 388/769] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:45 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:45.633353 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457c33-d988-41bb-bc58-037bfb615ecd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:45.768358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457c33-d988-41bb-bc58-037bfb615ecd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:45.804595 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5c595-a660-4580-931f-d3bf60ae6dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:45.805214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5c595-a660-4580-931f-d3bf60ae6dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:45.805492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5c595-a660-4580-931f-d3bf60ae6dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:45.805767 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5c595-a660-4580-931f-d3bf60ae6dc0 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:45.806451 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5c595-a660-4580-931f-d3bf60ae6dc0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:45.806758 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5c595-a660-4580-931f-d3bf60ae6dc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:45.808157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5c595-a660-4580-931f-d3bf60ae6dc0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:45.813318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 382/770] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:45.821370 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399eaa1-c11f-4e18-b3c5-f8d291d54ec8 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:45.937577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399eaa1-c11f-4e18-b3c5-f8d291d54ec8 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:45.972736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e02a-302e-42bc-ac0f-e22ac3699140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:45.973351 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e02a-302e-42bc-ac0f-e22ac3699140 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:45.973782 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e02a-302e-42bc-ac0f-e22ac3699140 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:45.974210 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e02a-302e-42bc-ac0f-e22ac3699140 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:45.974995 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e02a-302e-42bc-ac0f-e22ac3699140 None admin] RBAC: Adding query filter params (type=network) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:45.975367 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e02a-302e-42bc-ac0f-e22ac3699140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:45.976757 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e02a-302e-42bc-ac0f-e22ac3699140 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:45.982051 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 389/771] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:45.989785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5c595-a660-4580-931f-d3bf60ae6dc0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:46.057799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:46.124959 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7aaca-b22d-4d10-9365-2b3815d8cb97 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.125674 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7aaca-b22d-4d10-9365-2b3815d8cb97 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.126179 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7aaca-b22d-4d10-9365-2b3815d8cb97 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.127974 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 390/772] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:46.134910 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5c595-a660-4580-931f-d3bf60ae6dc0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:46.139853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b20a9-8f1c-4eab-b4f6-f146edf23a6f None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.140424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b20a9-8f1c-4eab-b4f6-f146edf23a6f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.140908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b20a9-8f1c-4eab-b4f6-f146edf23a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.172283 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-c36b20a9-8f1c-4eab-b4f6-f146edf23a6f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:46.175057 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-c36b20a9-8f1c-4eab-b4f6-f146edf23a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:46.198326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:46.216606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56d488-b12d-4520-9690-419e9c48db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:46.220260 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d488-b12d-4520-9690-419e9c48db69 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.220746 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d488-b12d-4520-9690-419e9c48db69 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.221211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d488-b12d-4520-9690-419e9c48db69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.222120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56d488-b12d-4520-9690-419e9c48db69 None admin] RBAC: Adding query filter params (interface=public, service_id=a20dd1cb48b04ab3b11920d92477fccb, region_id=RegionOne) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:46.222713 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56d488-b12d-4520-9690-419e9c48db69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:46.224679 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56d488-b12d-4520-9690-419e9c48db69 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:46.241193 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 383/773] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Oct 9 00:43:45 2022] GET /identity/v3/endpoints?service_id=a20dd1cb48b04ab3b11920d92477fccb&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:46.248819 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56d488-b12d-4520-9690-419e9c48db69 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:46.318685 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 391/774] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:46.324082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213cf5e-ec76-456a-9bcb-a2fc9d8e10f5 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.324082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213cf5e-ec76-456a-9bcb-a2fc9d8e10f5 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.324082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213cf5e-ec76-456a-9bcb-a2fc9d8e10f5 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.324082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 392/775] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:46.327435 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6d4f-ab1f-4732-afda-b293e3dba8e6 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.327715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6d4f-ab1f-4732-afda-b293e3dba8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.327985 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6d4f-ab1f-4732-afda-b293e3dba8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.364831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-809a6d4f-ab1f-4732-afda-b293e3dba8e6 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:46.366160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-809a6d4f-ab1f-4732-afda-b293e3dba8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:46.381852 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56d488-b12d-4520-9690-419e9c48db69 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:46.395950 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:46.447850 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaa5cd-e0f0-45a5-adb3-562e07c9d702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:46.448501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaa5cd-e0f0-45a5-adb3-562e07c9d702 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.448781 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaa5cd-e0f0-45a5-adb3-562e07c9d702 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.449046 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaa5cd-e0f0-45a5-adb3-562e07c9d702 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.449649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfaa5cd-e0f0-45a5-adb3-562e07c9d702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:46.451032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfaa5cd-e0f0-45a5-adb3-562e07c9d702 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:46.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 384/776] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Oct 9 00:43:46 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:46.491973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 393/777] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:46.580189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec95e9-5058-453d-afee-09bda2ef641d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.580389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec95e9-5058-453d-afee-09bda2ef641d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.580634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec95e9-5058-453d-afee-09bda2ef641d None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.582293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 385/778] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:46.588465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b684a-2bd3-4d1a-9140-2d26cb97e4d7 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.588759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b684a-2bd3-4d1a-9140-2d26cb97e4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.589016 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b684a-2bd3-4d1a-9140-2d26cb97e4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.617293 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-6f3b684a-2bd3-4d1a-9140-2d26cb97e4d7 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:46.618516 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-6f3b684a-2bd3-4d1a-9140-2d26cb97e4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:46.638368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec95e9-5058-453d-afee-09bda2ef641d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:46.732227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 394/779] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:46.806299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b684a-2bd3-4d1a-9140-2d26cb97e4d7 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:46.810048 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:46.837800 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec95e9-5058-453d-afee-09bda2ef641d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:46.893652 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf768bf-a832-4562-a2b2-40dfd41011b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:46.894290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf768bf-a832-4562-a2b2-40dfd41011b3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.894566 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf768bf-a832-4562-a2b2-40dfd41011b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.894836 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf768bf-a832-4562-a2b2-40dfd41011b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.918055 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b684a-2bd3-4d1a-9140-2d26cb97e4d7 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:46.920944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf768bf-a832-4562-a2b2-40dfd41011b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ebf768bf-a832-4562-a2b2-40dfd41011b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:46.925783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:46.926797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:46.927654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 386/780] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:46.932859 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf768bf-a832-4562-a2b2-40dfd41011b3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:46.963823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865e109-d1be-468b-90b2-e0067fef6c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:46.964534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865e109-d1be-468b-90b2-e0067fef6c98 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.964901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865e109-d1be-468b-90b2-e0067fef6c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.965171 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865e109-d1be-468b-90b2-e0067fef6c98 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.968084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865e109-d1be-468b-90b2-e0067fef6c98 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:46.968084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865e109-d1be-468b-90b2-e0067fef6c98 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-5865e109-d1be-468b-90b2-e0067fef6c98 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:46.977278 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:46.979244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:46.980336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 395/781] 10.222.0.43 () {56 vars in 1129 bytes} [Sun Oct 9 00:43:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:46.986963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865e109-d1be-468b-90b2-e0067fef6c98 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:46.999381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.066500 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.088601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf768bf-a832-4562-a2b2-40dfd41011b3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.106838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865e109-d1be-468b-90b2-e0067fef6c98 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.124839 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b1fc3-2388-4855-8567-5f692b1aebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.125763 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b1fc3-2388-4855-8567-5f692b1aebc6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.126042 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b1fc3-2388-4855-8567-5f692b1aebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.126312 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b1fc3-2388-4855-8567-5f692b1aebc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.127298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b1fc3-2388-4855-8567-5f692b1aebc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:47.127644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b1fc3-2388-4855-8567-5f692b1aebc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.129065 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b1fc3-2388-4855-8567-5f692b1aebc6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.144345 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68101c0b-406a-4ac6-b2b9-cbc59d462673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.145048 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68101c0b-406a-4ac6-b2b9-cbc59d462673 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.145644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68101c0b-406a-4ac6-b2b9-cbc59d462673 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.145809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 387/782] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:47.146056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68101c0b-406a-4ac6-b2b9-cbc59d462673 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.146751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68101c0b-406a-4ac6-b2b9-cbc59d462673 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:47.146914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b1fc3-2388-4855-8567-5f692b1aebc6 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.147180 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68101c0b-406a-4ac6-b2b9-cbc59d462673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.148635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68101c0b-406a-4ac6-b2b9-cbc59d462673 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.154879 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 396/783] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Oct 9 00:43:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:47.155928 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68101c0b-406a-4ac6-b2b9-cbc59d462673 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.267554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.273508 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68101c0b-406a-4ac6-b2b9-cbc59d462673 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.274698 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b1fc3-2388-4855-8567-5f692b1aebc6 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.304333 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.310977 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c556f1-784e-4696-828c-c2e55ba1dda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.311763 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c556f1-784e-4696-828c-c2e55ba1dda6 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.312258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c556f1-784e-4696-828c-c2e55ba1dda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.312633 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c556f1-784e-4696-828c-c2e55ba1dda6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.312842 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e719-6d6b-4763-b3d7-3f4be1d0b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.313474 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e719-6d6b-4763-b3d7-3f4be1d0b069 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.313744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e719-6d6b-4763-b3d7-3f4be1d0b069 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.314013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e719-6d6b-4763-b3d7-3f4be1d0b069 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.324602 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c556f1-784e-4696-828c-c2e55ba1dda6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.325371 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0e719-6d6b-4763-b3d7-3f4be1d0b069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:47.326290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c556f1-784e-4696-828c-c2e55ba1dda6 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a6f0e719-6d6b-4763-b3d7-3f4be1d0b069 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:47.331163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:47.332760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:47.334742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:47.344167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 388/784] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:47.344167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e719-6d6b-4763-b3d7-3f4be1d0b069 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-04c556f1-784e-4696-828c-c2e55ba1dda6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:47.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:47.346605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:47.348861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:47.348861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:47.348861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:47.348861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 397/785] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:47.348861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c556f1-784e-4696-828c-c2e55ba1dda6 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.448342 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e719-6d6b-4763-b3d7-3f4be1d0b069 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.449644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c556f1-784e-4696-828c-c2e55ba1dda6 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.483656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e536b5-f1ed-4858-b81b-733e6da9783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.484035 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f77b1-d323-40bb-95df-5c928a266fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.484289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e536b5-f1ed-4858-b81b-733e6da9783b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.484463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f77b1-d323-40bb-95df-5c928a266fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.484628 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f77b1-d323-40bb-95df-5c928a266fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.484771 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e536b5-f1ed-4858-b81b-733e6da9783b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.484921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f77b1-d323-40bb-95df-5c928a266fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.485062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e536b5-f1ed-4858-b81b-733e6da9783b None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.485472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f77b1-d323-40bb-95df-5c928a266fb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:47.485634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e536b5-f1ed-4858-b81b-733e6da9783b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:47.485776 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f77b1-d323-40bb-95df-5c928a266fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.485925 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e536b5-f1ed-4858-b81b-733e6da9783b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.487135 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f77b1-d323-40bb-95df-5c928a266fb1 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.487303 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e536b5-f1ed-4858-b81b-733e6da9783b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.492868 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 389/786] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:47.493767 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e536b5-f1ed-4858-b81b-733e6da9783b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.502538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 398/787] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:47.503693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f77b1-d323-40bb-95df-5c928a266fb1 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.520074 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.609128 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e536b5-f1ed-4858-b81b-733e6da9783b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.649833 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c5664-af43-4a08-b387-1da2332bf4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.651296 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5664-af43-4a08-b387-1da2332bf4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.651735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5664-af43-4a08-b387-1da2332bf4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.652179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5664-af43-4a08-b387-1da2332bf4b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.652974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c5664-af43-4a08-b387-1da2332bf4b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:47.653515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c5664-af43-4a08-b387-1da2332bf4b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.655123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c5664-af43-4a08-b387-1da2332bf4b0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.672392 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 390/788] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:47.673628 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c5664-af43-4a08-b387-1da2332bf4b0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.680733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.740079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f77b1-d323-40bb-95df-5c928a266fb1 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.762947 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.775038 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c1fc3-31f4-4385-b5e3-0d0485c19dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.775650 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c1fc3-31f4-4385-b5e3-0d0485c19dca None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.775924 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c1fc3-31f4-4385-b5e3-0d0485c19dca None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.778060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c1fc3-31f4-4385-b5e3-0d0485c19dca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.778794 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c1fc3-31f4-4385-b5e3-0d0485c19dca None admin] RBAC: Adding query filter params (interface=public, service_id=4e353c009b794cca830121a750b1c992, region_id=RegionOne) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:47.779105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c1fc3-31f4-4385-b5e3-0d0485c19dca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.780520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c1fc3-31f4-4385-b5e3-0d0485c19dca None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.793264 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 399/789] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/endpoints?service_id=4e353c009b794cca830121a750b1c992&interface=public®ion_id=RegionOne => generated 194 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:47.793264 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c1fc3-31f4-4385-b5e3-0d0485c19dca None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.795383 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c5664-af43-4a08-b387-1da2332bf4b0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.829243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbcd2f-b8c4-49b6-83b3-7918418b4144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.829785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbcd2f-b8c4-49b6-83b3-7918418b4144 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.830061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbcd2f-b8c4-49b6-83b3-7918418b4144 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.830316 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbcd2f-b8c4-49b6-83b3-7918418b4144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.841012 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbcd2f-b8c4-49b6-83b3-7918418b4144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.842474 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbcd2f-b8c4-49b6-83b3-7918418b4144 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7fbbcd2f-b8c4-49b6-83b3-7918418b4144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:47.857607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:47.858629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:47.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:47.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:47.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:47.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 391/790] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:47.859889 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a4e16-dfa5-4a4c-87c4-c3b2b3df07db None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.860287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a4e16-dfa5-4a4c-87c4-c3b2b3df07db None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.860430 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a4e16-dfa5-4a4c-87c4-c3b2b3df07db None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.864128 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 392/791] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:47.864128 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a4e16-dfa5-4a4c-87c4-c3b2b3df07db None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.912619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c1fc3-31f4-4385-b5e3-0d0485c19dca None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.924150 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.950992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058ff8-b565-4699-99f5-c02656d908c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.951624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058ff8-b565-4699-99f5-c02656d908c1 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.951897 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058ff8-b565-4699-99f5-c02656d908c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.952479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058ff8-b565-4699-99f5-c02656d908c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.960296 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd058ff8-b565-4699-99f5-c02656d908c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.961713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd058ff8-b565-4699-99f5-c02656d908c1 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.966105 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a4e16-dfa5-4a4c-87c4-c3b2b3df07db None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-dd058ff8-b565-4699-99f5-c02656d908c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:47.972830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:47.974105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:47.975279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:47.975279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:47.975279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:47.975279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:47.975279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:47.975279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:47.975279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:47.975279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:47.975279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:47.975279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:47.979207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 400/792] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:47.979783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058ff8-b565-4699-99f5-c02656d908c1 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.000301 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.006909 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf3ead-b7e9-4e51-a9eb-c7ded1a618fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.007724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3ead-b7e9-4e51-a9eb-c7ded1a618fc None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.008189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3ead-b7e9-4e51-a9eb-c7ded1a618fc None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.008618 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3ead-b7e9-4e51-a9eb-c7ded1a618fc None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.009361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf3ead-b7e9-4e51-a9eb-c7ded1a618fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.010874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf3ead-b7e9-4e51-a9eb-c7ded1a618fc None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.016185 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 393/793] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:48.017459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7466f-86a8-4ec5-a1b0-cd40072288b5 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.017869 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7466f-86a8-4ec5-a1b0-cd40072288b5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.018270 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7466f-86a8-4ec5-a1b0-cd40072288b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.037736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7cc7466f-86a8-4ec5-a1b0-cd40072288b5 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:48.039269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7cc7466f-86a8-4ec5-a1b0-cd40072288b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:48.101466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058ff8-b565-4699-99f5-c02656d908c1 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.116493 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 394/794] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:48.117669 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7466f-86a8-4ec5-a1b0-cd40072288b5 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.142885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aacd4d-3a7c-434d-a525-92aea39a0322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.143678 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aacd4d-3a7c-434d-a525-92aea39a0322 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.144093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aacd4d-3a7c-434d-a525-92aea39a0322 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.144495 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aacd4d-3a7c-434d-a525-92aea39a0322 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.145318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aacd4d-3a7c-434d-a525-92aea39a0322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:48.146429 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aacd4d-3a7c-434d-a525-92aea39a0322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.148353 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aacd4d-3a7c-434d-a525-92aea39a0322 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.174982 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 401/795] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:48.180634 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aacd4d-3a7c-434d-a525-92aea39a0322 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.235872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.295062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7466f-86a8-4ec5-a1b0-cd40072288b5 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.323845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.334799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f554-1258-4bc8-b8d7-1cfc4c90e115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.335409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f554-1258-4bc8-b8d7-1cfc4c90e115 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.335682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f554-1258-4bc8-b8d7-1cfc4c90e115 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.335946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f554-1258-4bc8-b8d7-1cfc4c90e115 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.336703 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37f554-1258-4bc8-b8d7-1cfc4c90e115 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:48.337003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37f554-1258-4bc8-b8d7-1cfc4c90e115 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.339543 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aacd4d-3a7c-434d-a525-92aea39a0322 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.340921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37f554-1258-4bc8-b8d7-1cfc4c90e115 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.362914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 395/796] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:48.369192 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f554-1258-4bc8-b8d7-1cfc4c90e115 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.398158 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c980e-f8b3-46ec-a0b1-8bb4529c0cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.398805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c980e-f8b3-46ec-a0b1-8bb4529c0cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.399105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c980e-f8b3-46ec-a0b1-8bb4529c0cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.399399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c980e-f8b3-46ec-a0b1-8bb4529c0cc8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.419680 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c980e-f8b3-46ec-a0b1-8bb4529c0cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.421161 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c980e-f8b3-46ec-a0b1-8bb4529c0cc8 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-eb9c980e-f8b3-46ec-a0b1-8bb4529c0cc8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:48.440160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:48.441266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 402/797] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:48.442507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c980e-f8b3-46ec-a0b1-8bb4529c0cc8 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.491523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f554-1258-4bc8-b8d7-1cfc4c90e115 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.527575 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f2bab-e820-4a70-b795-26c6b9e794c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.528283 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f2bab-e820-4a70-b795-26c6b9e794c8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.528555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f2bab-e820-4a70-b795-26c6b9e794c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.528817 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f2bab-e820-4a70-b795-26c6b9e794c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.539749 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f2bab-e820-4a70-b795-26c6b9e794c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.541336 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f2bab-e820-4a70-b795-26c6b9e794c8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.555505 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-9d4f2bab-e820-4a70-b795-26c6b9e794c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:48.562132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:48.563150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:48.564102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:48.564102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:48.564102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:48.564102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 396/798] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:48.564882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f2bab-e820-4a70-b795-26c6b9e794c8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.571087 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c980e-f8b3-46ec-a0b1-8bb4529c0cc8 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.609146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.613391 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ef202-b44a-48f5-9eb8-338f65a72ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.614384 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ef202-b44a-48f5-9eb8-338f65a72ecd None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.614861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ef202-b44a-48f5-9eb8-338f65a72ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.615336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ef202-b44a-48f5-9eb8-338f65a72ecd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.629292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ef202-b44a-48f5-9eb8-338f65a72ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-a57ef202-b44a-48f5-9eb8-338f65a72ecd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:48.637216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:48.638334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:48.639243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:48.641432 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 403/799] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:48.646615 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ef202-b44a-48f5-9eb8-338f65a72ecd None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.692329 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f2bab-e820-4a70-b795-26c6b9e794c8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.732522 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a52d7-1ccf-4278-a7f3-d4194a317d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.733542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a52d7-1ccf-4278-a7f3-d4194a317d7d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.734076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a52d7-1ccf-4278-a7f3-d4194a317d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.734641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a52d7-1ccf-4278-a7f3-d4194a317d7d None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.735667 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a52d7-1ccf-4278-a7f3-d4194a317d7d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:48.736214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a52d7-1ccf-4278-a7f3-d4194a317d7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.737911 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a52d7-1ccf-4278-a7f3-d4194a317d7d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.750232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ef202-b44a-48f5-9eb8-338f65a72ecd None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.762636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 397/800] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:48.763860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a52d7-1ccf-4278-a7f3-d4194a317d7d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.785118 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df667b1-5124-43ee-9b1c-2600d65be741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.785722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df667b1-5124-43ee-9b1c-2600d65be741 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.786046 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df667b1-5124-43ee-9b1c-2600d65be741 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.786315 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df667b1-5124-43ee-9b1c-2600d65be741 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.786957 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df667b1-5124-43ee-9b1c-2600d65be741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:48.787258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df667b1-5124-43ee-9b1c-2600d65be741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.788700 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df667b1-5124-43ee-9b1c-2600d65be741 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.800957 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 404/801] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:48.802360 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df667b1-5124-43ee-9b1c-2600d65be741 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.814229 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.884295 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a52d7-1ccf-4278-a7f3-d4194a317d7d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.912454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df667b1-5124-43ee-9b1c-2600d65be741 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.918331 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66331c80-5403-4655-a9b3-4f92fbe4ee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.918947 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331c80-5403-4655-a9b3-4f92fbe4ee82 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.919222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331c80-5403-4655-a9b3-4f92fbe4ee82 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.919491 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331c80-5403-4655-a9b3-4f92fbe4ee82 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.920177 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66331c80-5403-4655-a9b3-4f92fbe4ee82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:48.920478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66331c80-5403-4655-a9b3-4f92fbe4ee82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.921857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66331c80-5403-4655-a9b3-4f92fbe4ee82 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.931298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 398/802] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:48.932062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66331c80-5403-4655-a9b3-4f92fbe4ee82 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.959034 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641bc16-8995-417b-a8f1-dfd18b404056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.959677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641bc16-8995-417b-a8f1-dfd18b404056 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.959931 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641bc16-8995-417b-a8f1-dfd18b404056 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.960250 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641bc16-8995-417b-a8f1-dfd18b404056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.971045 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641bc16-8995-417b-a8f1-dfd18b404056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.973112 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641bc16-8995-417b-a8f1-dfd18b404056 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-3641bc16-8995-417b-a8f1-dfd18b404056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:48.988477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:48.989621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:48.990526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:48.990526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:48.990526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:48.994500 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 405/803] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:48.995922 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5303df-436c-4807-8d90-669dd0189daa None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.996230 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5303df-436c-4807-8d90-669dd0189daa None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.996502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5303df-436c-4807-8d90-669dd0189daa None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.000202 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 406/804] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:49.000202 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5303df-436c-4807-8d90-669dd0189daa None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:49.040140 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66331c80-5403-4655-a9b3-4f92fbe4ee82 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:49.068476 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:49.074332 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af278f1-d4d0-4255-bc51-192af1f95a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:49.074963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af278f1-d4d0-4255-bc51-192af1f95a15 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:49.075242 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af278f1-d4d0-4255-bc51-192af1f95a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:49.075542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af278f1-d4d0-4255-bc51-192af1f95a15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.083984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af278f1-d4d0-4255-bc51-192af1f95a15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:49.085619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af278f1-d4d0-4255-bc51-192af1f95a15 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-4af278f1-d4d0-4255-bc51-192af1f95a15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:49.098666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:49.100077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:49.101207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:49.101207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:49.101207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:49.101207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:49.101207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:49.101207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:49.101207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:49.101207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:49.104672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 399/805] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:49.105520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af278f1-d4d0-4255-bc51-192af1f95a15 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:49.117355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5303df-436c-4807-8d90-669dd0189daa None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:49.123475 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:49.156021 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866df914-64e1-4df3-8505-c74fcb41a312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:49.156960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df914-64e1-4df3-8505-c74fcb41a312 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:49.157389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df914-64e1-4df3-8505-c74fcb41a312 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:49.157877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866df914-64e1-4df3-8505-c74fcb41a312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.168705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866df914-64e1-4df3-8505-c74fcb41a312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:49.170502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866df914-64e1-4df3-8505-c74fcb41a312 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-866df914-64e1-4df3-8505-c74fcb41a312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:49.185619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:49.186652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:49.187587 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:49.187587 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:49.187587 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:49.187587 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 407/806] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:49.188200 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbb572-0e8d-4d10-be47-eca5fa520e33 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:49.188200 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbb572-0e8d-4d10-be47-eca5fa520e33 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:49.188462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbb572-0e8d-4d10-be47-eca5fa520e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.207428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-53bbb572-0e8d-4d10-be47-eca5fa520e33 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:49.208837 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-53bbb572-0e8d-4d10-be47-eca5fa520e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:49.211306 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af278f1-d4d0-4255-bc51-192af1f95a15 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:49.244527 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5220e7-ea4a-4ec6-a8d8-40793a0cd1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:49.245131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5220e7-ea4a-4ec6-a8d8-40793a0cd1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:49.245410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5220e7-ea4a-4ec6-a8d8-40793a0cd1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:49.245678 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5220e7-ea4a-4ec6-a8d8-40793a0cd1f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5220e7-ea4a-4ec6-a8d8-40793a0cd1f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:49.246614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5220e7-ea4a-4ec6-a8d8-40793a0cd1f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:49.247990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5220e7-ea4a-4ec6-a8d8-40793a0cd1f2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:49.260001 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 400/807] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:49.260802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5220e7-ea4a-4ec6-a8d8-40793a0cd1f2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:49.285575 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 408/808] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:49.286919 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbb572-0e8d-4d10-be47-eca5fa520e33 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:49.347029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:49.350641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:49.374476 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5220e7-ea4a-4ec6-a8d8-40793a0cd1f2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:49.410362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e30b4-fa83-4acb-b943-62496b8af468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:49.410818 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e30b4-fa83-4acb-b943-62496b8af468 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:49.411166 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e30b4-fa83-4acb-b943-62496b8af468 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:49.411533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e30b4-fa83-4acb-b943-62496b8af468 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.412359 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e30b4-fa83-4acb-b943-62496b8af468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:49.412659 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e30b4-fa83-4acb-b943-62496b8af468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:49.414161 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e30b4-fa83-4acb-b943-62496b8af468 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:49.414786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbb572-0e8d-4d10-be47-eca5fa520e33 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:49.431080 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 401/809] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:49.431080 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e30b4-fa83-4acb-b943-62496b8af468 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:49.463182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368df1-faef-461a-ae71-b8d2ada96780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:49.464072 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368df1-faef-461a-ae71-b8d2ada96780 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:49.464493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368df1-faef-461a-ae71-b8d2ada96780 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:49.464905 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368df1-faef-461a-ae71-b8d2ada96780 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.465725 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea368df1-faef-461a-ae71-b8d2ada96780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:49.466398 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea368df1-faef-461a-ae71-b8d2ada96780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:49.468817 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea368df1-faef-461a-ae71-b8d2ada96780 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:49.483751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 409/810] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:49.484914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368df1-faef-461a-ae71-b8d2ada96780 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:49.535730 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e30b4-fa83-4acb-b943-62496b8af468 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:49.570529 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de4f3-25ef-4825-bbec-261c05c0a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:49.571162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de4f3-25ef-4825-bbec-261c05c0a411 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:49.571437 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de4f3-25ef-4825-bbec-261c05c0a411 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:49.571705 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de4f3-25ef-4825-bbec-261c05c0a411 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.574425 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:49.579502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424de4f3-25ef-4825-bbec-261c05c0a411 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:49.581418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424de4f3-25ef-4825-bbec-261c05c0a411 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-424de4f3-25ef-4825-bbec-261c05c0a411 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:49.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:49.593944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:49.594940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:49.594940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:49.594940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:49.594940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:49.594940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:49.594940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:49.594940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:49.594940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:49.594940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 402/811] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:49.594940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de4f3-25ef-4825-bbec-261c05c0a411 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:49.605654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368df1-faef-461a-ae71-b8d2ada96780 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:49.608363 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:49.645654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a267415-f956-48ba-87f4-c9f7112e5412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:49.646461 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a267415-f956-48ba-87f4-c9f7112e5412 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:49.646735 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a267415-f956-48ba-87f4-c9f7112e5412 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:49.646998 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a267415-f956-48ba-87f4-c9f7112e5412 None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/7b36a416960d4106935476ef2b1682f6/roles/275b5127bdb241f1bf7690c67d80591b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.661728 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a267415-f956-48ba-87f4-c9f7112e5412 None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=7b36a416960d4106935476ef2b1682f6, role_id=275b5127bdb241f1bf7690c67d80591b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:49.663078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a267415-f956-48ba-87f4-c9f7112e5412 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:49.688080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 410/812] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:49 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/7b36a416960d4106935476ef2b1682f6/roles/275b5127bdb241f1bf7690c67d80591b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:49.688080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a267415-f956-48ba-87f4-c9f7112e5412 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:49.703380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de4f3-25ef-4825-bbec-261c05c0a411 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:49.742071 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53e55-cb07-47ce-af88-0c36197c0c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:49.742760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53e55-cb07-47ce-af88-0c36197c0c47 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:49.743091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53e55-cb07-47ce-af88-0c36197c0c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:49.743368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53e55-cb07-47ce-af88-0c36197c0c47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.752387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc53e55-cb07-47ce-af88-0c36197c0c47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:49.753877 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc53e55-cb07-47ce-af88-0c36197c0c47 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ccc53e55-cb07-47ce-af88-0c36197c0c47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:49.767282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:49.768407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:49.769374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:49.769374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:49.769374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:49.769374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:49.769374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:49.769374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:49.769374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:49.769374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:49.769374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:49.769374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:49.769374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 403/813] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Oct 9 00:43:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:49.769990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53e55-cb07-47ce-af88-0c36197c0c47 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:49.846863 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:49.848859 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a267415-f956-48ba-87f4-c9f7112e5412 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:49.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969b3d-d9f2-4451-a4c7-88b9f9c80dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:49.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969b3d-d9f2-4451-a4c7-88b9f9c80dfa None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:49.894508 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969b3d-d9f2-4451-a4c7-88b9f9c80dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:49.894670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969b3d-d9f2-4451-a4c7-88b9f9c80dfa None admin] PATH_INFO: `/v3/services/network` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.895232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51969b3d-d9f2-4451-a4c7-88b9f9c80dfa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:49.896716 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51969b3d-d9f2-4451-a4c7-88b9f9c80dfa None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-51969b3d-d9f2-4451-a4c7-88b9f9c80dfa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:49.905713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:49.906761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:49.908590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 411/814] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:49 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:49.909415 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969b3d-d9f2-4451-a4c7-88b9f9c80dfa None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:49.921757 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53e55-cb07-47ce-af88-0c36197c0c47 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:49.933137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:49.970468 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db931330-115d-4f69-a769-12032721af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:49.971444 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db931330-115d-4f69-a769-12032721af90 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:49.971917 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db931330-115d-4f69-a769-12032721af90 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:49.972922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db931330-115d-4f69-a769-12032721af90 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:49.974271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db931330-115d-4f69-a769-12032721af90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:49.974790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db931330-115d-4f69-a769-12032721af90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:49.977280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db931330-115d-4f69-a769-12032721af90 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:49.994654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 404/815] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:49.995769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db931330-115d-4f69-a769-12032721af90 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:50.029295 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969b3d-d9f2-4451-a4c7-88b9f9c80dfa None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:50.065067 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42285f4-3779-4a38-b1d2-317950f12cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:50.065736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42285f4-3779-4a38-b1d2-317950f12cca None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:50.066109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42285f4-3779-4a38-b1d2-317950f12cca None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:50.066472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42285f4-3779-4a38-b1d2-317950f12cca None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:50.067452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42285f4-3779-4a38-b1d2-317950f12cca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:50.068115 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42285f4-3779-4a38-b1d2-317950f12cca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:50.069612 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42285f4-3779-4a38-b1d2-317950f12cca None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:50.092885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 412/816] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Oct 9 00:43:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:50.094082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42285f4-3779-4a38-b1d2-317950f12cca None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:50.142046 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db931330-115d-4f69-a769-12032721af90 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:50.158727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:50.177172 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118958eb-0bc7-4a06-8c20-4941ad43795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:50.177905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118958eb-0bc7-4a06-8c20-4941ad43795f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:50.178181 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118958eb-0bc7-4a06-8c20-4941ad43795f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:50.178445 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118958eb-0bc7-4a06-8c20-4941ad43795f None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:50.179063 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118958eb-0bc7-4a06-8c20-4941ad43795f None admin] RBAC: Adding query filter params (name=network) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:50.179358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118958eb-0bc7-4a06-8c20-4941ad43795f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:50.180746 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118958eb-0bc7-4a06-8c20-4941ad43795f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:50.186076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 405/817] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:50.186249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118958eb-0bc7-4a06-8c20-4941ad43795f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:50.193290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:50.224555 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42285f4-3779-4a38-b1d2-317950f12cca None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:50.268243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07030698-2415-493c-8cf4-9973a9df047c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:50.269186 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07030698-2415-493c-8cf4-9973a9df047c None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:50.270005 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07030698-2415-493c-8cf4-9973a9df047c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:50.270462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07030698-2415-493c-8cf4-9973a9df047c None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/cbc22a3976aa47cfb4367b0a433742ea/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:50.274064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07030698-2415-493c-8cf4-9973a9df047c None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=cbc22a3976aa47cfb4367b0a433742ea, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:50.275966 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07030698-2415-493c-8cf4-9973a9df047c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:50.291583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 413/818] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:50 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/cbc22a3976aa47cfb4367b0a433742ea/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:50.292858 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07030698-2415-493c-8cf4-9973a9df047c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:50.341813 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118958eb-0bc7-4a06-8c20-4941ad43795f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:50.414219 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c327b-1ee1-469e-b930-66ddf2946e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:50.414872 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c327b-1ee1-469e-b930-66ddf2946e5e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:50.415147 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c327b-1ee1-469e-b930-66ddf2946e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:50.415474 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c327b-1ee1-469e-b930-66ddf2946e5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:50.431443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07030698-2415-493c-8cf4-9973a9df047c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:50.479269 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fde90-fbfc-4efe-9a01-414143417bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:50.480072 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fde90-fbfc-4efe-9a01-414143417bae None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:50.480356 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fde90-fbfc-4efe-9a01-414143417bae None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:50.480626 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fde90-fbfc-4efe-9a01-414143417bae None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:50.481258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fde90-fbfc-4efe-9a01-414143417bae None admin] RBAC: Adding query filter params (type=network) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:50.481555 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fde90-fbfc-4efe-9a01-414143417bae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:50.483797 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fde90-fbfc-4efe-9a01-414143417bae None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:50.486772 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:50.488162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:50.493058 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 414/819] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:50.494840 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab852684-0ee1-48aa-9fab-8c2ae072598f None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:50.501116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab852684-0ee1-48aa-9fab-8c2ae072598f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:50.501397 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab852684-0ee1-48aa-9fab-8c2ae072598f None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:50.503433 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 415/820] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:50.504325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab852684-0ee1-48aa-9fab-8c2ae072598f None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:50.520565 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c327b-1ee1-469e-b930-66ddf2946e5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:50.522556 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c327b-1ee1-469e-b930-66ddf2946e5e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:50.630032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab852684-0ee1-48aa-9fab-8c2ae072598f None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:50.663045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 406/821] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:43:50.664833 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81fe62-c1f9-4595-bb41-94dec0dc3f4b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:50.665333 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81fe62-c1f9-4595-bb41-94dec0dc3f4b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:50.665803 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81fe62-c1f9-4595-bb41-94dec0dc3f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:50.674773 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29679-0f9d-45b9-916b-9ce90f5fbffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:50.675386 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29679-0f9d-45b9-916b-9ce90f5fbffc None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:50.675657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29679-0f9d-45b9-916b-9ce90f5fbffc None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:50.675921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29679-0f9d-45b9-916b-9ce90f5fbffc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:50.676688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e29679-0f9d-45b9-916b-9ce90f5fbffc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:50.678039 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e29679-0f9d-45b9-916b-9ce90f5fbffc None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:50.688668 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7f81fe62-c1f9-4595-bb41-94dec0dc3f4b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:50.691456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7f81fe62-c1f9-4595-bb41-94dec0dc3f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:50.702768 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 416/822] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:43:50 2022] POST /identity/v3/endpoints => generated 337 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:50.704254 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29679-0f9d-45b9-916b-9ce90f5fbffc None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:50.772179 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:50.805779 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 407/823] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:50.838167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29679-0f9d-45b9-916b-9ce90f5fbffc None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:50.877746 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b5b1c-7912-4216-b79b-09cfcfec78e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:50.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b5b1c-7912-4216-b79b-09cfcfec78e1 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:50.878672 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b5b1c-7912-4216-b79b-09cfcfec78e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:50.878940 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b5b1c-7912-4216-b79b-09cfcfec78e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:50.891062 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b5b1c-7912-4216-b79b-09cfcfec78e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:50.892539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b5b1c-7912-4216-b79b-09cfcfec78e1 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-1f2b5b1c-7912-4216-b79b-09cfcfec78e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:50.907828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:50.908914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:50.909833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:50.909833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:50.909833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:50.909833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 417/824] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:50.914755 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81fe62-c1f9-4595-bb41-94dec0dc3f4b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:50.923886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:51.037097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81fe62-c1f9-4595-bb41-94dec0dc3f4b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:51.082753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee0f47-d13e-41bc-ac46-f9062eb52321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:51.083436 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0f47-d13e-41bc-ac46-f9062eb52321 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.083705 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0f47-d13e-41bc-ac46-f9062eb52321 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.083983 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0f47-d13e-41bc-ac46-f9062eb52321 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.084628 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee0f47-d13e-41bc-ac46-f9062eb52321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:51.084918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee0f47-d13e-41bc-ac46-f9062eb52321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:51.086285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee0f47-d13e-41bc-ac46-f9062eb52321 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:51.100336 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 408/825] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:51.105513 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b5b1c-7912-4216-b79b-09cfcfec78e1 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:51.234172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b5b1c-7912-4216-b79b-09cfcfec78e1 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:51.234928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee0f47-d13e-41bc-ac46-f9062eb52321 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:51.246568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:51.275226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496719af-b0a4-4826-9e8f-a40aa8c3411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:51.276027 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496719af-b0a4-4826-9e8f-a40aa8c3411d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.276411 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496719af-b0a4-4826-9e8f-a40aa8c3411d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.276774 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496719af-b0a4-4826-9e8f-a40aa8c3411d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.284035 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496719af-b0a4-4826-9e8f-a40aa8c3411d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:51.285617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496719af-b0a4-4826-9e8f-a40aa8c3411d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-496719af-b0a4-4826-9e8f-a40aa8c3411d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:51.297434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:51.298577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:51.299748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:51.299748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:51.299748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:51.299748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:51.299748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:51.299748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:51.299748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:51.299748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:51.301310 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 418/826] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:51.306687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496719af-b0a4-4826-9e8f-a40aa8c3411d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:51.325764 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:51.369497 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee0f47-d13e-41bc-ac46-f9062eb52321 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:51.411704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b8b59-fc88-4372-b88e-0346d024e24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:51.412370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8b59-fc88-4372-b88e-0346d024e24c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.412644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8b59-fc88-4372-b88e-0346d024e24c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.412908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8b59-fc88-4372-b88e-0346d024e24c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.413483 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b8b59-fc88-4372-b88e-0346d024e24c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:51.415041 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b8b59-fc88-4372-b88e-0346d024e24c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:51.420911 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496719af-b0a4-4826-9e8f-a40aa8c3411d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-475b8b59-fc88-4372-b88e-0346d024e24c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:51.424184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:51.425398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:51.426554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 409/827] 10.222.0.43 () {56 vars in 1129 bytes} [Sun Oct 9 00:43:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:51.433597 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b8b59-fc88-4372-b88e-0346d024e24c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:51.457590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8f94e-3832-414e-8250-edbcb07b16ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:51.458229 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f94e-3832-414e-8250-edbcb07b16ed None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.458504 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f94e-3832-414e-8250-edbcb07b16ed None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.458769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f94e-3832-414e-8250-edbcb07b16ed None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.459451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8f94e-3832-414e-8250-edbcb07b16ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:51.459755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8f94e-3832-414e-8250-edbcb07b16ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:51.461308 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8f94e-3832-414e-8250-edbcb07b16ed None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:51.476101 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 419/828] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:51.481518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8f94e-3832-414e-8250-edbcb07b16ed None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:51.511616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:51.559649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b8b59-fc88-4372-b88e-0346d024e24c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:51.589507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8f94e-3832-414e-8250-edbcb07b16ed None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:51.594720 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:51.601790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565133-a823-4554-8d5f-be460d1da695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:51.602746 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565133-a823-4554-8d5f-be460d1da695 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.603028 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565133-a823-4554-8d5f-be460d1da695 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.603301 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565133-a823-4554-8d5f-be460d1da695 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.603925 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565133-a823-4554-8d5f-be460d1da695 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:51.604263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565133-a823-4554-8d5f-be460d1da695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:51.606236 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565133-a823-4554-8d5f-be460d1da695 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:51.612376 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 410/829] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Oct 9 00:43:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:51.617724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565133-a823-4554-8d5f-be460d1da695 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:51.634476 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243178b-118d-483e-a2c0-3d5da9cdd5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:51.635480 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243178b-118d-483e-a2c0-3d5da9cdd5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.635954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243178b-118d-483e-a2c0-3d5da9cdd5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.636507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243178b-118d-483e-a2c0-3d5da9cdd5d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.637421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243178b-118d-483e-a2c0-3d5da9cdd5d6 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=f960fdabbffa4813a0ea46bb82218f09) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:51.637949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243178b-118d-483e-a2c0-3d5da9cdd5d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:51.639600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243178b-118d-483e-a2c0-3d5da9cdd5d6 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:51.646636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 420/830] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:51 2022] GET /identity/v3/role_assignments?user.id=f960fdabbffa4813a0ea46bb82218f09&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:51.736389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565133-a823-4554-8d5f-be460d1da695 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:51.780575 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0107fc1-692c-40dd-8ee7-46a932514be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:51.781198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0107fc1-692c-40dd-8ee7-46a932514be2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.781473 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0107fc1-692c-40dd-8ee7-46a932514be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.781743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0107fc1-692c-40dd-8ee7-46a932514be2 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.782373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0107fc1-692c-40dd-8ee7-46a932514be2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:51.782670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0107fc1-692c-40dd-8ee7-46a932514be2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:51.784069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0107fc1-692c-40dd-8ee7-46a932514be2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:51.790140 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 411/831] 10.222.0.43 () {56 vars in 1124 bytes} [Sun Oct 9 00:43:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:51.796607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243178b-118d-483e-a2c0-3d5da9cdd5d6 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:51.903621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:51.914848 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243178b-118d-483e-a2c0-3d5da9cdd5d6 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:51.953282 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b4ace-20a2-4208-8503-1845c5b6e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:51.953899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b4ace-20a2-4208-8503-1845c5b6e8ce None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.954171 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b4ace-20a2-4208-8503-1845c5b6e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.954440 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b4ace-20a2-4208-8503-1845c5b6e8ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.955103 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b4ace-20a2-4208-8503-1845c5b6e8ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:51.956509 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b4ace-20a2-4208-8503-1845c5b6e8ce None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:51.977943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 421/832] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:43:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:43:52.032063 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7164d02-c4f3-4b09-acbb-477b26c97547 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:52.032600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7164d02-c4f3-4b09-acbb-477b26c97547 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:52.032600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7164d02-c4f3-4b09-acbb-477b26c97547 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:52.033972 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 412/833] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:52.040535 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9811a-1f58-459a-a98e-d533a26d1c20 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:52.040871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9811a-1f58-459a-a98e-d533a26d1c20 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:52.041139 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9811a-1f58-459a-a98e-d533a26d1c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:52.061808 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-e6e9811a-1f58-459a-a98e-d533a26d1c20 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:52.063189 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e6e9811a-1f58-459a-a98e-d533a26d1c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:52.146619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 422/834] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:52.410173 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7164d02-c4f3-4b09-acbb-477b26c97547 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:52.472879 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:52.516979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7164d02-c4f3-4b09-acbb-477b26c97547 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:52.552829 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5015b-fcf3-4457-bf5b-585a82de84a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:52.553484 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5015b-fcf3-4457-bf5b-585a82de84a6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:52.553756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5015b-fcf3-4457-bf5b-585a82de84a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:52.554021 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5015b-fcf3-4457-bf5b-585a82de84a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:52.566581 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5015b-fcf3-4457-bf5b-585a82de84a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a4a5015b-fcf3-4457-bf5b-585a82de84a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:52.572160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:52.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:52.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 413/835] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:52.579971 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9811a-1f58-459a-a98e-d533a26d1c20 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:52.657326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:52.676475 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdc82-a54f-4aa4-b45e-f8d9b82f4fb9 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:52.676838 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdc82-a54f-4aa4-b45e-f8d9b82f4fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:52.677162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cdc82-a54f-4aa4-b45e-f8d9b82f4fb9 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:52.678863 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 414/836] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:52.684306 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22ccc2-b2a0-49cb-ab6e-eadf3fcbc771 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:52.684480 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9811a-1f58-459a-a98e-d533a26d1c20 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:52.684603 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22ccc2-b2a0-49cb-ab6e-eadf3fcbc771 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:52.684832 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22ccc2-b2a0-49cb-ab6e-eadf3fcbc771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:52.704824 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9b22ccc2-b2a0-49cb-ab6e-eadf3fcbc771 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:52.706019 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9b22ccc2-b2a0-49cb-ab6e-eadf3fcbc771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:52.723511 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f3139-c68f-4a30-9afa-7bc33e728268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:52.724251 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3139-c68f-4a30-9afa-7bc33e728268 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:52.724621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3139-c68f-4a30-9afa-7bc33e728268 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:52.724902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3139-c68f-4a30-9afa-7bc33e728268 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:52.725559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f3139-c68f-4a30-9afa-7bc33e728268 None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:52.725856 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f3139-c68f-4a30-9afa-7bc33e728268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:52.727213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f3139-c68f-4a30-9afa-7bc33e728268 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:52.736811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 423/837] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:52.742708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f3139-c68f-4a30-9afa-7bc33e728268 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:52.784189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 415/838] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:52.862847 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f3139-c68f-4a30-9afa-7bc33e728268 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:52.897290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5da40b-8657-468b-9e80-5db5b3d55ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:52.898307 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5da40b-8657-468b-9e80-5db5b3d55ccc None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:52.898801 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5da40b-8657-468b-9e80-5db5b3d55ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:52.899316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5da40b-8657-468b-9e80-5db5b3d55ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:52.902421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:52.912471 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5da40b-8657-468b-9e80-5db5b3d55ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:52.914373 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5da40b-8657-468b-9e80-5db5b3d55ccc None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-ee5da40b-8657-468b-9e80-5db5b3d55ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:52.933663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:52.934686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:52.935623 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:52.935623 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:52.935623 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:52.935623 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 424/839] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:52.940455 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22ccc2-b2a0-49cb-ab6e-eadf3fcbc771 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:52.991064 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:53.044031 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22ccc2-b2a0-49cb-ab6e-eadf3fcbc771 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:53.074169 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5da40b-8657-468b-9e80-5db5b3d55ccc None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:53.078546 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf76342-95ff-447c-a804-30a36f2bd454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:53.079159 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf76342-95ff-447c-a804-30a36f2bd454 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:53.079436 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf76342-95ff-447c-a804-30a36f2bd454 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:53.079706 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf76342-95ff-447c-a804-30a36f2bd454 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:53.080365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf76342-95ff-447c-a804-30a36f2bd454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:53.080663 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf76342-95ff-447c-a804-30a36f2bd454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:53.082039 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf76342-95ff-447c-a804-30a36f2bd454 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:53.097912 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 416/840] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:53.103516 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf76342-95ff-447c-a804-30a36f2bd454 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:53.178478 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5da40b-8657-468b-9e80-5db5b3d55ccc None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:53.206076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf76342-95ff-447c-a804-30a36f2bd454 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:53.211163 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812df03-6b78-4b06-96bf-8f67a1b76fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:53.211791 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812df03-6b78-4b06-96bf-8f67a1b76fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:53.212102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812df03-6b78-4b06-96bf-8f67a1b76fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:53.212377 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812df03-6b78-4b06-96bf-8f67a1b76fc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:53.215400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:53.224652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812df03-6b78-4b06-96bf-8f67a1b76fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-1812df03-6b78-4b06-96bf-8f67a1b76fc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:53.229921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:53.231108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:53.232292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 425/841] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:53.240831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812df03-6b78-4b06-96bf-8f67a1b76fc3 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:53.250727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba28ba-51a8-4ed3-b487-3bbbcd2b3d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:53.251600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba28ba-51a8-4ed3-b487-3bbbcd2b3d28 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:53.252020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba28ba-51a8-4ed3-b487-3bbbcd2b3d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:53.252478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba28ba-51a8-4ed3-b487-3bbbcd2b3d28 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:53.263998 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba28ba-51a8-4ed3-b487-3bbbcd2b3d28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:53.266412 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba28ba-51a8-4ed3-b487-3bbbcd2b3d28 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a7ba28ba-51a8-4ed3-b487-3bbbcd2b3d28 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:53.278700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:53.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:53.281088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:53.281088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:53.281088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:53.281088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:53.281088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:53.281088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:53.281088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:53.281088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:53.281088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:53.281088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:53.287628 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 417/842] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Oct 9 00:43:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:53.289024 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba28ba-51a8-4ed3-b487-3bbbcd2b3d28 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:53.299882 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:53.353074 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812df03-6b78-4b06-96bf-8f67a1b76fc3 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:53.388274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd691e-8fe4-4016-a4c6-0076f40d662e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:53.389054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd691e-8fe4-4016-a4c6-0076f40d662e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:53.389421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd691e-8fe4-4016-a4c6-0076f40d662e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:53.389791 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd691e-8fe4-4016-a4c6-0076f40d662e None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:53.390550 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd691e-8fe4-4016-a4c6-0076f40d662e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:53.390949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd691e-8fe4-4016-a4c6-0076f40d662e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:53.392429 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd691e-8fe4-4016-a4c6-0076f40d662e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:53.392671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba28ba-51a8-4ed3-b487-3bbbcd2b3d28 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:53.405983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 426/843] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:53.406986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd691e-8fe4-4016-a4c6-0076f40d662e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:53.428724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358f130-32fc-4bb4-8f14-5d64a0fd8d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:53.429561 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358f130-32fc-4bb4-8f14-5d64a0fd8d20 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:53.430107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358f130-32fc-4bb4-8f14-5d64a0fd8d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:53.430823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358f130-32fc-4bb4-8f14-5d64a0fd8d20 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:53.431699 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358f130-32fc-4bb4-8f14-5d64a0fd8d20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:53.432167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358f130-32fc-4bb4-8f14-5d64a0fd8d20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:53.433920 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358f130-32fc-4bb4-8f14-5d64a0fd8d20 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:53.457807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 418/844] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Oct 9 00:43:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:53.459111 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358f130-32fc-4bb4-8f14-5d64a0fd8d20 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:53.502789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:53.509541 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd691e-8fe4-4016-a4c6-0076f40d662e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:53.520616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:53.545730 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d96f1e-0aeb-4d68-bd66-1a35ce00e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:53.546503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d96f1e-0aeb-4d68-bd66-1a35ce00e6ef None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:53.546886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d96f1e-0aeb-4d68-bd66-1a35ce00e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:53.547250 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d96f1e-0aeb-4d68-bd66-1a35ce00e6ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:53.558318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d96f1e-0aeb-4d68-bd66-1a35ce00e6ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:53.559901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d96f1e-0aeb-4d68-bd66-1a35ce00e6ef None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:53.569060 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358f130-32fc-4bb4-8f14-5d64a0fd8d20 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-d3d96f1e-0aeb-4d68-bd66-1a35ce00e6ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:53.574510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:53.575718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:53.576906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:53.576906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:53.576906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:53.582561 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 427/845] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:53.583641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d96f1e-0aeb-4d68-bd66-1a35ce00e6ef None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:53.609639 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c959c8-9625-406b-995c-474ae2228ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:53.610592 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c959c8-9625-406b-995c-474ae2228ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:53.611002 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c959c8-9625-406b-995c-474ae2228ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:53.611411 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c959c8-9625-406b-995c-474ae2228ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:53.685495 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c959c8-9625-406b-995c-474ae2228ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:53.686600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d96f1e-0aeb-4d68-bd66-1a35ce00e6ef None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:53.687374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c959c8-9625-406b-995c-474ae2228ba1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:53.715662 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:53.721689 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bcd9b-5e37-439a-9d4e-d9660fc9e110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:53.722450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bcd9b-5e37-439a-9d4e-d9660fc9e110 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:53.722823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bcd9b-5e37-439a-9d4e-d9660fc9e110 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:53.723190 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bcd9b-5e37-439a-9d4e-d9660fc9e110 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:53.724161 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bcd9b-5e37-439a-9d4e-d9660fc9e110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:53.724608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bcd9b-5e37-439a-9d4e-d9660fc9e110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:53.726076 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bcd9b-5e37-439a-9d4e-d9660fc9e110 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:53.743557 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 428/846] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:53.744637 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bcd9b-5e37-439a-9d4e-d9660fc9e110 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:53.773848 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:53.806415 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 419/847] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:53 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:43:53.807458 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c959c8-9625-406b-995c-474ae2228ba1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:53.856922 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bcd9b-5e37-439a-9d4e-d9660fc9e110 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:53.894097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205c5fb-3196-44e1-9f2c-90d626597663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:53.895133 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205c5fb-3196-44e1-9f2c-90d626597663 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:53.895737 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205c5fb-3196-44e1-9f2c-90d626597663 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:53.896326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205c5fb-3196-44e1-9f2c-90d626597663 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:53.905367 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205c5fb-3196-44e1-9f2c-90d626597663 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:53.907257 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205c5fb-3196-44e1-9f2c-90d626597663 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:53.914612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c959c8-9625-406b-995c-474ae2228ba1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-6205c5fb-3196-44e1-9f2c-90d626597663 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:53.921421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:53.922447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:53.923424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:53.923424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:53.923424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:53.923424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:53.923424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:53.923424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:53.923424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:53.923424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:53.923424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:53.923424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:53.930554 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 429/848] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:53.932179 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205c5fb-3196-44e1-9f2c-90d626597663 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:53.945729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:53.958315 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a4b2b-fadf-40c6-94d2-19076c106b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:53.959342 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4b2b-fadf-40c6-94d2-19076c106b56 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:53.959853 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4b2b-fadf-40c6-94d2-19076c106b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:53.960869 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4b2b-fadf-40c6-94d2-19076c106b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:53.974899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a4b2b-fadf-40c6-94d2-19076c106b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:53.977399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a4b2b-fadf-40c6-94d2-19076c106b56 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b81a4b2b-fadf-40c6-94d2-19076c106b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:53.997232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:53.998456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:53.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:53.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:53.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:54.001858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 420/849] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:54.008563 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a4b2b-fadf-40c6-94d2-19076c106b56 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.033498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:54.055102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205c5fb-3196-44e1-9f2c-90d626597663 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:54.090269 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057a17-367c-4b90-9f61-fa1d80c147a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:54.090874 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057a17-367c-4b90-9f61-fa1d80c147a4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.091148 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057a17-367c-4b90-9f61-fa1d80c147a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.091411 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057a17-367c-4b90-9f61-fa1d80c147a4 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.092147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8057a17-367c-4b90-9f61-fa1d80c147a4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:54.092449 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8057a17-367c-4b90-9f61-fa1d80c147a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:54.094126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8057a17-367c-4b90-9f61-fa1d80c147a4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:54.115894 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 430/850] 10.222.0.43 () {56 vars in 1135 bytes} [Sun Oct 9 00:43:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:54.116586 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a4b2b-fadf-40c6-94d2-19076c106b56 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:54.123701 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518873f3-1cc3-4884-be92-8f4ab70895be None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.124096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518873f3-1cc3-4884-be92-8f4ab70895be None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.124348 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518873f3-1cc3-4884-be92-8f4ab70895be None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.126601 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 431/851] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:54.127219 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518873f3-1cc3-4884-be92-8f4ab70895be None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.157092 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29547de-4a98-4754-b5f7-298912c9bb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:54.157702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29547de-4a98-4754-b5f7-298912c9bb15 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.157969 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29547de-4a98-4754-b5f7-298912c9bb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.158236 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29547de-4a98-4754-b5f7-298912c9bb15 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.158872 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29547de-4a98-4754-b5f7-298912c9bb15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:54.159171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29547de-4a98-4754-b5f7-298912c9bb15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:54.160597 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29547de-4a98-4754-b5f7-298912c9bb15 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:54.173631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 421/852] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:54.174829 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe91d-9831-4b1d-ab46-333bfb381569 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.175109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe91d-9831-4b1d-ab46-333bfb381569 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.175377 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe91d-9831-4b1d-ab46-333bfb381569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.193783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0befe91d-9831-4b1d-ab46-333bfb381569 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:54.194981 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0befe91d-9831-4b1d-ab46-333bfb381569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:54.225771 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:54.241460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518873f3-1cc3-4884-be92-8f4ab70895be None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:54.264172 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 422/853] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:54.265018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befe91d-9831-4b1d-ab46-333bfb381569 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.283696 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d043924-917f-48c5-b946-3fecdbaa047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:54.284330 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d043924-917f-48c5-b946-3fecdbaa047f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.284599 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d043924-917f-48c5-b946-3fecdbaa047f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.284858 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d043924-917f-48c5-b946-3fecdbaa047f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.295754 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:54.362142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d043924-917f-48c5-b946-3fecdbaa047f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:54.363757 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d043924-917f-48c5-b946-3fecdbaa047f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:54.364641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befe91d-9831-4b1d-ab46-333bfb381569 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:54.400196 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c224d6-7aad-4eba-a39e-95c39e84a5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:54.400824 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c224d6-7aad-4eba-a39e-95c39e84a5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.401092 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c224d6-7aad-4eba-a39e-95c39e84a5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.401357 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c224d6-7aad-4eba-a39e-95c39e84a5e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.409456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c224d6-7aad-4eba-a39e-95c39e84a5e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:54.411568 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c224d6-7aad-4eba-a39e-95c39e84a5e1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-80c224d6-7aad-4eba-a39e-95c39e84a5e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:54.423788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:54.424891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:54.425812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:54.425812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:54.425812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:54.425812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:54.425812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:54.425812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:54.425812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:54.425812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:54.425812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 423/854] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:54.426447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b5fa-06d2-4399-ab75-b86e86a450d8 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.426738 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b5fa-06d2-4399-ab75-b86e86a450d8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.427013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b5fa-06d2-4399-ab75-b86e86a450d8 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.432078 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 424/855] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:54.432078 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0b5fa-06d2-4399-ab75-b86e86a450d8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.461389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:54.480142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 432/856] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:43:54.481233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05c0f9-6dff-4b5e-bf9e-8be8a413c3da None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.481508 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05c0f9-6dff-4b5e-bf9e-8be8a413c3da None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.481772 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05c0f9-6dff-4b5e-bf9e-8be8a413c3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.499529 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-1d05c0f9-6dff-4b5e-bf9e-8be8a413c3da None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:54.500727 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-1d05c0f9-6dff-4b5e-bf9e-8be8a413c3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:54.536279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:54.541620 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0b5fa-06d2-4399-ab75-b86e86a450d8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:54.567877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 433/857] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:54.568729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05c0f9-6dff-4b5e-bf9e-8be8a413c3da None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.587072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594788d-caa1-4db3-8a88-99f7b3f85e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:54.587658 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594788d-caa1-4db3-8a88-99f7b3f85e50 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.587940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594788d-caa1-4db3-8a88-99f7b3f85e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.588216 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594788d-caa1-4db3-8a88-99f7b3f85e50 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.588894 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594788d-caa1-4db3-8a88-99f7b3f85e50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:54.589190 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594788d-caa1-4db3-8a88-99f7b3f85e50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:54.590610 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594788d-caa1-4db3-8a88-99f7b3f85e50 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:54.606977 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 425/858] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:54.606977 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594788d-caa1-4db3-8a88-99f7b3f85e50 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.679312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05c0f9-6dff-4b5e-bf9e-8be8a413c3da None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:54.696980 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:54.711182 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594788d-caa1-4db3-8a88-99f7b3f85e50 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:54.713145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4ddc7-8d55-4678-a540-c2e2cfaf722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:54.714531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4ddc7-8d55-4678-a540-c2e2cfaf722d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.714898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4ddc7-8d55-4678-a540-c2e2cfaf722d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.715168 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4ddc7-8d55-4678-a540-c2e2cfaf722d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.726265 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4ddc7-8d55-4678-a540-c2e2cfaf722d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:54.727693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4ddc7-8d55-4678-a540-c2e2cfaf722d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-cdc4ddc7-8d55-4678-a540-c2e2cfaf722d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:54.742212 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:54.743390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:54.744675 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:54.744675 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:54.744675 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:54.747991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 434/859] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:54.748851 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4ddc7-8d55-4678-a540-c2e2cfaf722d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.753187 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb2b00-c132-4f51-bbca-8d9869ccb7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:54.753840 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb2b00-c132-4f51-bbca-8d9869ccb7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.754117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb2b00-c132-4f51-bbca-8d9869ccb7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.754385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb2b00-c132-4f51-bbca-8d9869ccb7a3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.755022 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb2b00-c132-4f51-bbca-8d9869ccb7a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:54.756742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb2b00-c132-4f51-bbca-8d9869ccb7a3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-48eb2b00-c132-4f51-bbca-8d9869ccb7a3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:54.766259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:54.767218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:54.768199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 426/860] 10.222.0.43 () {56 vars in 1132 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:54.771463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb2b00-c132-4f51-bbca-8d9869ccb7a3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.783196 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:54.867137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4ddc7-8d55-4678-a540-c2e2cfaf722d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:54.870821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb2b00-c132-4f51-bbca-8d9869ccb7a3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:54.900690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bf07b-51e0-4c86-ba7c-c161a5d1ba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:54.901293 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bf07b-51e0-4c86-ba7c-c161a5d1ba05 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.901568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bf07b-51e0-4c86-ba7c-c161a5d1ba05 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.901834 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bf07b-51e0-4c86-ba7c-c161a5d1ba05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.902546 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bf07b-51e0-4c86-ba7c-c161a5d1ba05 None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=7b36a416960d4106935476ef2b1682f6) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:54.902849 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bf07b-51e0-4c86-ba7c-c161a5d1ba05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:54.904247 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e7b81-ab34-43d0-afaa-8a48e777433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:54.904364 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bf07b-51e0-4c86-ba7c-c161a5d1ba05 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:54.904850 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e7b81-ab34-43d0-afaa-8a48e777433a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.905123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e7b81-ab34-43d0-afaa-8a48e777433a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.905388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e7b81-ab34-43d0-afaa-8a48e777433a None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.906012 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e7b81-ab34-43d0-afaa-8a48e777433a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:54.906305 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e7b81-ab34-43d0-afaa-8a48e777433a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:54.907656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e7b81-ab34-43d0-afaa-8a48e777433a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:54.909851 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 435/861] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/role_assignments?user.id=7b36a416960d4106935476ef2b1682f6&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:54.910623 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bf07b-51e0-4c86-ba7c-c161a5d1ba05 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.927624 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 427/862] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:54.928924 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e7b81-ab34-43d0-afaa-8a48e777433a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.948607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:55.014399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:55.031019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bf07b-51e0-4c86-ba7c-c161a5d1ba05 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:55.049786 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e7b81-ab34-43d0-afaa-8a48e777433a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:55.070074 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092aa40-72ed-4232-93da-dc6578c32880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:55.070704 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092aa40-72ed-4232-93da-dc6578c32880 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:55.070980 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092aa40-72ed-4232-93da-dc6578c32880 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:55.071246 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092aa40-72ed-4232-93da-dc6578c32880 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:55.072371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092aa40-72ed-4232-93da-dc6578c32880 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:55.072692 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092aa40-72ed-4232-93da-dc6578c32880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:55.074427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092aa40-72ed-4232-93da-dc6578c32880 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:55.080005 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 436/863] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:55.080868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092aa40-72ed-4232-93da-dc6578c32880 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:55.093320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f39ce0-7eff-44d7-87bc-2de1b639d194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:55.094046 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f39ce0-7eff-44d7-87bc-2de1b639d194 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:55.094361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f39ce0-7eff-44d7-87bc-2de1b639d194 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:55.094584 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f39ce0-7eff-44d7-87bc-2de1b639d194 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:55.095184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f39ce0-7eff-44d7-87bc-2de1b639d194 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:55.096590 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f39ce0-7eff-44d7-87bc-2de1b639d194 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-c8f39ce0-7eff-44d7-87bc-2de1b639d194 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:55.107459 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:55.108528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:55.109551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 428/864] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:55.111890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f39ce0-7eff-44d7-87bc-2de1b639d194 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:55.193864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:55.203845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092aa40-72ed-4232-93da-dc6578c32880 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:55.218118 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f39ce0-7eff-44d7-87bc-2de1b639d194 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:55.239307 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae45ed8-8590-485e-99ee-126ad61d256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:55.240106 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae45ed8-8590-485e-99ee-126ad61d256d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:55.240380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae45ed8-8590-485e-99ee-126ad61d256d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:55.240648 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae45ed8-8590-485e-99ee-126ad61d256d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:55.247494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae45ed8-8590-485e-99ee-126ad61d256d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:55.248961 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae45ed8-8590-485e-99ee-126ad61d256d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:55.253971 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b628f-f876-4546-bc16-f38d8f99db99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:55.254630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b628f-f876-4546-bc16-f38d8f99db99 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:55.254994 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b628f-f876-4546-bc16-f38d8f99db99 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:55.255340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b628f-f876-4546-bc16-f38d8f99db99 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:55.255877 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b628f-f876-4546-bc16-f38d8f99db99 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:55.256208 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b628f-f876-4546-bc16-f38d8f99db99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:55.257875 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b628f-f876-4546-bc16-f38d8f99db99 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-3ae45ed8-8590-485e-99ee-126ad61d256d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:55.261056 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:55.261938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:55.268145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:55.268145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:55.268145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:55.268145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:55.268145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:55.268145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:55.268145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:55.268145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:55.268145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 437/865] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:55.268145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae45ed8-8590-485e-99ee-126ad61d256d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:55.272476 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 429/866] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:55.273261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b628f-f876-4546-bc16-f38d8f99db99 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:55.281556 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:55.387554 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae45ed8-8590-485e-99ee-126ad61d256d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:55.423955 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b628f-f876-4546-bc16-f38d8f99db99 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:55.425029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc607-c9b5-4413-b591-689248103a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:55.425743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc607-c9b5-4413-b591-689248103a9e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:55.426086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc607-c9b5-4413-b591-689248103a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:55.426486 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc607-c9b5-4413-b591-689248103a9e None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:55.427294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fc607-c9b5-4413-b591-689248103a9e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:55.427662 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fc607-c9b5-4413-b591-689248103a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:55.429276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fc607-c9b5-4413-b591-689248103a9e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:55.439133 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 438/867] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:55.441119 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc607-c9b5-4413-b591-689248103a9e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:55.477799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e5eba-0aa8-4def-801c-c7a4affa2a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:55.478426 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e5eba-0aa8-4def-801c-c7a4affa2a04 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:55.478687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e5eba-0aa8-4def-801c-c7a4affa2a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:55.478958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e5eba-0aa8-4def-801c-c7a4affa2a04 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:55.479644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e5eba-0aa8-4def-801c-c7a4affa2a04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:55.479949 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e5eba-0aa8-4def-801c-c7a4affa2a04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:55.481516 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e5eba-0aa8-4def-801c-c7a4affa2a04 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:55.490973 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:55.496084 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 430/868] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:55.502595 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e5eba-0aa8-4def-801c-c7a4affa2a04 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:55.539171 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:55.566303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc607-c9b5-4413-b591-689248103a9e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:55.602300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067c3db-aa36-4667-8354-2a564e42d366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:55.603337 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c3db-aa36-4667-8354-2a564e42d366 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:55.603820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c3db-aa36-4667-8354-2a564e42d366 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:55.604401 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c3db-aa36-4667-8354-2a564e42d366 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:55.605207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067c3db-aa36-4667-8354-2a564e42d366 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:55.605724 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067c3db-aa36-4667-8354-2a564e42d366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:55.607314 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067c3db-aa36-4667-8354-2a564e42d366 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:55.619205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 439/869] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:55.631828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e5eba-0aa8-4def-801c-c7a4affa2a04 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:55.674544 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9a3b8-06bd-42ab-b368-2d784164aad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:55.675170 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9a3b8-06bd-42ab-b368-2d784164aad7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:55.675444 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9a3b8-06bd-42ab-b368-2d784164aad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:55.675714 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9a3b8-06bd-42ab-b368-2d784164aad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:55.676601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9a3b8-06bd-42ab-b368-2d784164aad7 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=cbc22a3976aa47cfb4367b0a433742ea) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:55.677033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9a3b8-06bd-42ab-b368-2d784164aad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:55.678687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9a3b8-06bd-42ab-b368-2d784164aad7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:55.685924 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 431/870] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:55 2022] GET /identity/v3/role_assignments?user.id=cbc22a3976aa47cfb4367b0a433742ea&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:57.208638 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaeef9-a8ac-4dda-8bf9-2e9764d12728 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:57.209149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaeef9-a8ac-4dda-8bf9-2e9764d12728 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:57.209420 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaeef9-a8ac-4dda-8bf9-2e9764d12728 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:57.211274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 440/871] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:57.217537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f3474-6a0a-4515-9af5-b06c9ca1dd49 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:57.218400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f3474-6a0a-4515-9af5-b06c9ca1dd49 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:57.218871 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f3474-6a0a-4515-9af5-b06c9ca1dd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:57.239235 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-745f3474-6a0a-4515-9af5-b06c9ca1dd49 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:57.240834 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-745f3474-6a0a-4515-9af5-b06c9ca1dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:57.305748 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:57.319230 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 432/872] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:57.540523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1ab26-aae3-47cf-8459-772f1c246aba None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:57.541204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1ab26-aae3-47cf-8459-772f1c246aba None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:57.541680 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1ab26-aae3-47cf-8459-772f1c246aba None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:57.543604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 441/873] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:57.549004 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80085d-c03a-4928-9d24-4883afcac417 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:57.549290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80085d-c03a-4928-9d24-4883afcac417 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:57.549565 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80085d-c03a-4928-9d24-4883afcac417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:57.569542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-af80085d-c03a-4928-9d24-4883afcac417 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:57.570741 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-af80085d-c03a-4928-9d24-4883afcac417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:57.592027 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1ab26-aae3-47cf-8459-772f1c246aba None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:57.654968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 433/874] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:57.710723 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1ab26-aae3-47cf-8459-772f1c246aba None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:57.746738 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1f564-a097-4217-bf7b-2c447cbb12c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:57.747380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f564-a097-4217-bf7b-2c447cbb12c8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:57.747654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f564-a097-4217-bf7b-2c447cbb12c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:57.747925 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f564-a097-4217-bf7b-2c447cbb12c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:57.755342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:57.760187 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1f564-a097-4217-bf7b-2c447cbb12c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-bff1f564-a097-4217-bf7b-2c447cbb12c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:57.765663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:57.766640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:57.767526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 442/875] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Oct 9 00:43:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:57.775282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80085d-c03a-4928-9d24-4883afcac417 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:57.901165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80085d-c03a-4928-9d24-4883afcac417 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:57.901766 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2c65-140f-413f-9ac6-c633109e923b None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:57.902052 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2c65-140f-413f-9ac6-c633109e923b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:57.902360 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef2c65-140f-413f-9ac6-c633109e923b None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:57.905096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 443/876] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:57.914340 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157d4e-5be1-44f1-aa9b-9cd47cd1eedb None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:57.914610 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157d4e-5be1-44f1-aa9b-9cd47cd1eedb None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:57.914961 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157d4e-5be1-44f1-aa9b-9cd47cd1eedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:57.934100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:57.935945 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-80157d4e-5be1-44f1-aa9b-9cd47cd1eedb None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:57.937472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-80157d4e-5be1-44f1-aa9b-9cd47cd1eedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:57.947480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b07d-1ee5-4e80-8a08-eae63042b188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:57.948470 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b07d-1ee5-4e80-8a08-eae63042b188 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:57.948930 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b07d-1ee5-4e80-8a08-eae63042b188 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:57.949423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123b07d-1ee5-4e80-8a08-eae63042b188 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:57.950385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123b07d-1ee5-4e80-8a08-eae63042b188 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:57.950894 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123b07d-1ee5-4e80-8a08-eae63042b188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:57.952685 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123b07d-1ee5-4e80-8a08-eae63042b188 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:57.962768 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 434/877] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Oct 9 00:43:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:57.968504 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b07d-1ee5-4e80-8a08-eae63042b188 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.014852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 444/878] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:58.015752 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80157d4e-5be1-44f1-aa9b-9cd47cd1eedb None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.080106 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123b07d-1ee5-4e80-8a08-eae63042b188 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.115215 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7948220-fe71-49d6-939a-6b8c99b3d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.116263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948220-fe71-49d6-939a-6b8c99b3d6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.116544 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948220-fe71-49d6-939a-6b8c99b3d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.116816 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7948220-fe71-49d6-939a-6b8c99b3d6c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.126688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80157d4e-5be1-44f1-aa9b-9cd47cd1eedb None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.127243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7948220-fe71-49d6-939a-6b8c99b3d6c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.128729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7948220-fe71-49d6-939a-6b8c99b3d6c4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e7948220-fe71-49d6-939a-6b8c99b3d6c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:58.143340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:58.144369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:58.145471 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:58.145471 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:58.145471 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:58.145471 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 435/879] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:58.146152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d256483-cb03-4566-ac79-5ebef5a8f1d3 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.146249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d256483-cb03-4566-ac79-5ebef5a8f1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.146530 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d256483-cb03-4566-ac79-5ebef5a8f1d3 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.147910 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 436/880] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:58.152874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d256483-cb03-4566-ac79-5ebef5a8f1d3 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.161572 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:58.171531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e14cc-c47f-4e98-9096-7aca0bb44c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.172398 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e14cc-c47f-4e98-9096-7aca0bb44c7e None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.173176 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e14cc-c47f-4e98-9096-7aca0bb44c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.173454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e14cc-c47f-4e98-9096-7aca0bb44c7e None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.174258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e14cc-c47f-4e98-9096-7aca0bb44c7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.175820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e14cc-c47f-4e98-9096-7aca0bb44c7e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.196221 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 445/881] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:43:58 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:58.197989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1a0bd-40bd-4b21-9993-e493a611f22b None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.198447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1a0bd-40bd-4b21-9993-e493a611f22b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.198869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1a0bd-40bd-4b21-9993-e493a611f22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.223218 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-cdb1a0bd-40bd-4b21-9993-e493a611f22b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:58.224574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:58.225789 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-cdb1a0bd-40bd-4b21-9993-e493a611f22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:58.284131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d256483-cb03-4566-ac79-5ebef5a8f1d3 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.316378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 446/882] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:58 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:58.316378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1a0bd-40bd-4b21-9993-e493a611f22b None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.336220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971c50-a4b9-4075-8226-d618f7a326b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.337120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971c50-a4b9-4075-8226-d618f7a326b0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.337589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971c50-a4b9-4075-8226-d618f7a326b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.338031 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971c50-a4b9-4075-8226-d618f7a326b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.339548 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971c50-a4b9-4075-8226-d618f7a326b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:58.340349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971c50-a4b9-4075-8226-d618f7a326b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.342776 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971c50-a4b9-4075-8226-d618f7a326b0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.360401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 437/883] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:58.371631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971c50-a4b9-4075-8226-d618f7a326b0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.437506 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1a0bd-40bd-4b21-9993-e493a611f22b None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.462463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:58.484809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:58.487454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d0619-9fda-48c3-baef-a994414b284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.488736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0619-9fda-48c3-baef-a994414b284b None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.489422 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0619-9fda-48c3-baef-a994414b284b None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.490097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0619-9fda-48c3-baef-a994414b284b None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.491028 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0619-9fda-48c3-baef-a994414b284b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.492486 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0619-9fda-48c3-baef-a994414b284b None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.492669 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971c50-a4b9-4075-8226-d618f7a326b0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.515522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 447/884] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:43:58 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:58.545787 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585412e2-cfb1-4d3c-a441-a3aa6a5c9e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.546504 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585412e2-cfb1-4d3c-a441-a3aa6a5c9e7d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.546783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585412e2-cfb1-4d3c-a441-a3aa6a5c9e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.547044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585412e2-cfb1-4d3c-a441-a3aa6a5c9e7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.557312 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585412e2-cfb1-4d3c-a441-a3aa6a5c9e7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.558842 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585412e2-cfb1-4d3c-a441-a3aa6a5c9e7d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-585412e2-cfb1-4d3c-a441-a3aa6a5c9e7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:58.571619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:58.572715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:58.574277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:58.574277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:58.574277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:58.574277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:58.574277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:58.574277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:58.574277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:58.574277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:58.574277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:58.574277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:58.574277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 438/885] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Oct 9 00:43:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:58.579080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d0619-9fda-48c3-baef-a994414b284b None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.599531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585412e2-cfb1-4d3c-a441-a3aa6a5c9e7d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.707362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d0619-9fda-48c3-baef-a994414b284b None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.710742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585412e2-cfb1-4d3c-a441-a3aa6a5c9e7d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.749831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8789d46-c94e-49c1-b208-715945382a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.750451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8789d46-c94e-49c1-b208-715945382a5a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.750728 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8789d46-c94e-49c1-b208-715945382a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.750995 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8789d46-c94e-49c1-b208-715945382a5a None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.751713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8789d46-c94e-49c1-b208-715945382a5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:58.752014 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8789d46-c94e-49c1-b208-715945382a5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.752191 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922208cc-8a99-46de-b287-209e965c49da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.752826 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922208cc-8a99-46de-b287-209e965c49da None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.753646 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922208cc-8a99-46de-b287-209e965c49da None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.753646 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922208cc-8a99-46de-b287-209e965c49da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.753829 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8789d46-c94e-49c1-b208-715945382a5a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.753993 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922208cc-8a99-46de-b287-209e965c49da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.755806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922208cc-8a99-46de-b287-209e965c49da None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-922208cc-8a99-46de-b287-209e965c49da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:58.771728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:58.772929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:43:58.773802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 439/886] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:58.774618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 448/887] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Oct 9 00:43:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:58.779248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922208cc-8a99-46de-b287-209e965c49da None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.780578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8789d46-c94e-49c1-b208-715945382a5a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.796463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:58.819846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:58.900493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8789d46-c94e-49c1-b208-715945382a5a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.920251 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922208cc-8a99-46de-b287-209e965c49da None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.939244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b43f-b130-41ed-a1fd-973cc89f25a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.940022 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b43f-b130-41ed-a1fd-973cc89f25a4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.940443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b43f-b130-41ed-a1fd-973cc89f25a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.940812 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b43f-b130-41ed-a1fd-973cc89f25a4 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.941538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b43f-b130-41ed-a1fd-973cc89f25a4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:58.941939 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b43f-b130-41ed-a1fd-973cc89f25a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.943577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b43f-b130-41ed-a1fd-973cc89f25a4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.949785 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 449/888] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:58.955433 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b43f-b130-41ed-a1fd-973cc89f25a4 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.959545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27879e6-63a8-443a-8188-4b66308f956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.960489 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27879e6-63a8-443a-8188-4b66308f956f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.960983 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27879e6-63a8-443a-8188-4b66308f956f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.961444 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27879e6-63a8-443a-8188-4b66308f956f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:59.032248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27879e6-63a8-443a-8188-4b66308f956f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:59.034054 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27879e6-63a8-443a-8188-4b66308f956f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:59.049844 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:59.063662 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:59.069246 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b43f-b130-41ed-a1fd-973cc89f25a4 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:59.110306 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5bd19-a283-40e1-b2ee-e3ba524bc182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:59.111109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bd19-a283-40e1-b2ee-e3ba524bc182 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:59.111421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bd19-a283-40e1-b2ee-e3ba524bc182 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:59.111614 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bd19-a283-40e1-b2ee-e3ba524bc182 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:59.112272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5bd19-a283-40e1-b2ee-e3ba524bc182 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:59.112567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5bd19-a283-40e1-b2ee-e3ba524bc182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:59.113963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5bd19-a283-40e1-b2ee-e3ba524bc182 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:59.124237 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 450/889] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:59.163446 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 440/890] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:58 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 09 00:43:59.169714 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5bd19-a283-40e1-b2ee-e3ba524bc182 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:59.287174 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5bd19-a283-40e1-b2ee-e3ba524bc182 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:59.327130 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1c1af-3818-4779-b769-cd2c9d2e28c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:59.328211 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1c1af-3818-4779-b769-cd2c9d2e28c2 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:59.328704 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1c1af-3818-4779-b769-cd2c9d2e28c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:59.329178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1c1af-3818-4779-b769-cd2c9d2e28c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:59.340431 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1c1af-3818-4779-b769-cd2c9d2e28c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:59.342179 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1c1af-3818-4779-b769-cd2c9d2e28c2 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-6da1c1af-3818-4779-b769-cd2c9d2e28c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:59.357498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:59.358585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:59.359618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:59.359618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:59.359618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:59.361781 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 451/891] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:59.367963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27879e6-63a8-443a-8188-4b66308f956f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:59.475054 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27879e6-63a8-443a-8188-4b66308f956f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:59.492682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:59.515665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6267934-45df-4ea2-83f6-bfbcf9fd1f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:59.516662 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6267934-45df-4ea2-83f6-bfbcf9fd1f86 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:59.517174 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6267934-45df-4ea2-83f6-bfbcf9fd1f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:59.517654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6267934-45df-4ea2-83f6-bfbcf9fd1f86 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:59.518503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6267934-45df-4ea2-83f6-bfbcf9fd1f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:59.519011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6267934-45df-4ea2-83f6-bfbcf9fd1f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:59.520810 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6267934-45df-4ea2-83f6-bfbcf9fd1f86 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:59.533698 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 441/892] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:59.539690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1c1af-3818-4779-b769-cd2c9d2e28c2 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:59.559146 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:59.645107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1c1af-3818-4779-b769-cd2c9d2e28c2 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:59.680004 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f112-8220-4a1b-b610-54b4d2f9c6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:59.681097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f112-8220-4a1b-b610-54b4d2f9c6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:59.681603 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f112-8220-4a1b-b610-54b4d2f9c6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:59.682083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f112-8220-4a1b-b610-54b4d2f9c6e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:59.689135 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506f112-8220-4a1b-b610-54b4d2f9c6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:59.690816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506f112-8220-4a1b-b610-54b4d2f9c6e6 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-3506f112-8220-4a1b-b610-54b4d2f9c6e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:59.702877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:59.703890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:59.704863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:59.704863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:59.704863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:59.704863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:59.704863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:59.704863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:59.704863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:59.704863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:43:59.707334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 452/893] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:59.713421 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6267934-45df-4ea2-83f6-bfbcf9fd1f86 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:59.820453 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6267934-45df-4ea2-83f6-bfbcf9fd1f86 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:59.856265 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e404f5f-2e8e-4d44-b997-2fa48be56da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:59.856896 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e404f5f-2e8e-4d44-b997-2fa48be56da6 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:59.857207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e404f5f-2e8e-4d44-b997-2fa48be56da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:59.857522 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e404f5f-2e8e-4d44-b997-2fa48be56da6 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:59.858234 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e404f5f-2e8e-4d44-b997-2fa48be56da6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:59.858551 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e404f5f-2e8e-4d44-b997-2fa48be56da6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:59.860071 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e404f5f-2e8e-4d44-b997-2fa48be56da6 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:59.873879 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 442/894] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:59.880080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f112-8220-4a1b-b610-54b4d2f9c6e6 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:59.962609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:59.990180 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f112-8220-4a1b-b610-54b4d2f9c6e6 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:00.024574 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a512abe-42dd-427b-94a4-b496922d8e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:00.025183 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512abe-42dd-427b-94a4-b496922d8e76 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:00.025455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512abe-42dd-427b-94a4-b496922d8e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:00.025720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512abe-42dd-427b-94a4-b496922d8e76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:00.026435 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512abe-42dd-427b-94a4-b496922d8e76 None admin] RBAC: Adding query filter params (role.id=20ab666cb7654e36a5ca610eb516a482, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=7b36a416960d4106935476ef2b1682f6) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:00.026733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512abe-42dd-427b-94a4-b496922d8e76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:00.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512abe-42dd-427b-94a4-b496922d8e76 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:00.034103 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 453/895] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:59 2022] GET /identity/v3/role_assignments?user.id=7b36a416960d4106935476ef2b1682f6&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=20ab666cb7654e36a5ca610eb516a482 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:00.485821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412932fe-cfaf-4c6d-9b4a-088607dcae35 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:00.486361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412932fe-cfaf-4c6d-9b4a-088607dcae35 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:00.486361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412932fe-cfaf-4c6d-9b4a-088607dcae35 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:00.487924 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 443/896] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:00.493675 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ef34-63ea-4ebd-9736-e23066b3b853 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:00.494132 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ef34-63ea-4ebd-9736-e23066b3b853 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:00.494214 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203ef34-63ea-4ebd-9736-e23066b3b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:00.513027 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-2203ef34-63ea-4ebd-9736-e23066b3b853 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:00.515432 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-2203ef34-63ea-4ebd-9736-e23066b3b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:00.588159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 454/897] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:00.785565 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3313aa3-cd6d-4c41-9643-b2e871f1bcf8 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:00.785972 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3313aa3-cd6d-4c41-9643-b2e871f1bcf8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:00.786255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3313aa3-cd6d-4c41-9643-b2e871f1bcf8 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:00.790481 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 444/898] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:00.798217 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d773b1a-a767-4699-87c2-bc47676b7ee2 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:00.798761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d773b1a-a767-4699-87c2-bc47676b7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:00.799226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d773b1a-a767-4699-87c2-bc47676b7ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:00.817893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-3d773b1a-a767-4699-87c2-bc47676b7ee2 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:00.819385 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3d773b1a-a767-4699-87c2-bc47676b7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:00.849256 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3313aa3-cd6d-4c41-9643-b2e871f1bcf8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:00.886386 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:00.888955 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:00.893447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 455/899] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:00.962471 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3313aa3-cd6d-4c41-9643-b2e871f1bcf8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:00.999126 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6d245-b1fc-4702-82db-f51b82e1b67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:00.999759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d245-b1fc-4702-82db-f51b82e1b67a None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.000034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d245-b1fc-4702-82db-f51b82e1b67a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.000328 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d245-b1fc-4702-82db-f51b82e1b67a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.000907 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6d245-b1fc-4702-82db-f51b82e1b67a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.002280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6d245-b1fc-4702-82db-f51b82e1b67a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-c3e6d245-b1fc-4702-82db-f51b82e1b67a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:01.011537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:01.012574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:01.013743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 445/900] 10.222.0.43 () {56 vars in 1132 bytes} [Sun Oct 9 00:44:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:44:01.021288 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d773b1a-a767-4699-87c2-bc47676b7ee2 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.123180 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d773b1a-a767-4699-87c2-bc47676b7ee2 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:01.158327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de4fd6-0a75-49b0-8897-970e0a449ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:01.159289 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de4fd6-0a75-49b0-8897-970e0a449ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.159772 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de4fd6-0a75-49b0-8897-970e0a449ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.160267 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de4fd6-0a75-49b0-8897-970e0a449ef2 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.161271 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de4fd6-0a75-49b0-8897-970e0a449ef2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:01.161853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de4fd6-0a75-49b0-8897-970e0a449ef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.163407 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de4fd6-0a75-49b0-8897-970e0a449ef2 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.169104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6d245-b1fc-4702-82db-f51b82e1b67a None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.172125 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 456/901] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:01.174767 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de4fd6-0a75-49b0-8897-970e0a449ef2 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.241193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:01.272195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:01.276137 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6d245-b1fc-4702-82db-f51b82e1b67a None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:01.286074 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de4fd6-0a75-49b0-8897-970e0a449ef2 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:01.313697 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce393b-1559-4083-8f87-dcfd52ab7881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:01.314356 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce393b-1559-4083-8f87-dcfd52ab7881 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.314634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce393b-1559-4083-8f87-dcfd52ab7881 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.315192 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce393b-1559-4083-8f87-dcfd52ab7881 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.315800 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce393b-1559-4083-8f87-dcfd52ab7881 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.318374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce393b-1559-4083-8f87-dcfd52ab7881 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.325823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffbb1c-b538-4a66-8f86-c684493ef83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:01.326777 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffbb1c-b538-4a66-8f86-c684493ef83f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.327199 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffbb1c-b538-4a66-8f86-c684493ef83f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.327617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffbb1c-b538-4a66-8f86-c684493ef83f None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.328437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffbb1c-b538-4a66-8f86-c684493ef83f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:01.328937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffbb1c-b538-4a66-8f86-c684493ef83f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-dbce393b-1559-4083-8f87-dcfd52ab7881 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:01.329202 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:01.331681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 446/902] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:01.334372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffbb1c-b538-4a66-8f86-c684493ef83f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.337558 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce393b-1559-4083-8f87-dcfd52ab7881 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.345417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 457/903] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:01.346899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffbb1c-b538-4a66-8f86-c684493ef83f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.455447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce393b-1559-4083-8f87-dcfd52ab7881 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:01.469495 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffbb1c-b538-4a66-8f86-c684493ef83f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:01.488714 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e0b3a-01ae-4c46-9677-e837c36cd4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:01.489502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0b3a-01ae-4c46-9677-e837c36cd4aa None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.489622 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0b3a-01ae-4c46-9677-e837c36cd4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.489892 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0b3a-01ae-4c46-9677-e837c36cd4aa None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.490465 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e0b3a-01ae-4c46-9677-e837c36cd4aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:01.490761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e0b3a-01ae-4c46-9677-e837c36cd4aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.492150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e0b3a-01ae-4c46-9677-e837c36cd4aa None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.496734 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 447/904] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:01.497920 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ec3bf-52c4-4012-9722-fc3d6384cf02 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.498198 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ec3bf-52c4-4012-9722-fc3d6384cf02 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.498463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ec3bf-52c4-4012-9722-fc3d6384cf02 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.499789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 448/905] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:01.505202 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:01.505652 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ec3bf-52c4-4012-9722-fc3d6384cf02 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.516127 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0876b-4cb5-47e4-95c0-162aef7899dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:01.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0876b-4cb5-47e4-95c0-162aef7899dc None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.517027 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0876b-4cb5-47e4-95c0-162aef7899dc None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.517655 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0876b-4cb5-47e4-95c0-162aef7899dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.518349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0876b-4cb5-47e4-95c0-162aef7899dc None admin] RBAC: Adding query filter params (interface=public, service_id=5077ac93969e4d5385c6e7b5c195fedb, region_id=RegionOne) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:01.518963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0876b-4cb5-47e4-95c0-162aef7899dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.520434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0876b-4cb5-47e4-95c0-162aef7899dc None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 458/906] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/endpoints?service_id=5077ac93969e4d5385c6e7b5c195fedb&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:01.526994 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ca9f-e3c3-47de-a1c9-88a52ed5327a None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.527275 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ca9f-e3c3-47de-a1c9-88a52ed5327a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.527543 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ca9f-e3c3-47de-a1c9-88a52ed5327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.539057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:01.547046 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-5c27ca9f-e3c3-47de-a1c9-88a52ed5327a None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:01.548256 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-5c27ca9f-e3c3-47de-a1c9-88a52ed5327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:01.615093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ec3bf-52c4-4012-9722-fc3d6384cf02 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:01.622426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 459/907] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:01.622426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27ca9f-e3c3-47de-a1c9-88a52ed5327a None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.656450 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba20b3-4a06-4d09-8847-ed3948fcfb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:01.657049 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba20b3-4a06-4d09-8847-ed3948fcfb49 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.657318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba20b3-4a06-4d09-8847-ed3948fcfb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.657581 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba20b3-4a06-4d09-8847-ed3948fcfb49 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.658194 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba20b3-4a06-4d09-8847-ed3948fcfb49 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:01.658485 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba20b3-4a06-4d09-8847-ed3948fcfb49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.660206 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba20b3-4a06-4d09-8847-ed3948fcfb49 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.670021 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 449/908] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:01.671004 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba20b3-4a06-4d09-8847-ed3948fcfb49 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.737022 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27ca9f-e3c3-47de-a1c9-88a52ed5327a None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:01.760688 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:01.771905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:01.777142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab098187-db9c-4d89-90a1-e37e1a7cce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:01.777770 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098187-db9c-4d89-90a1-e37e1a7cce72 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.778038 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098187-db9c-4d89-90a1-e37e1a7cce72 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.778298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098187-db9c-4d89-90a1-e37e1a7cce72 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.778899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab098187-db9c-4d89-90a1-e37e1a7cce72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.780333 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab098187-db9c-4d89-90a1-e37e1a7cce72 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.791980 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba20b3-4a06-4d09-8847-ed3948fcfb49 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:01.793793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 460/909] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:44:01.833641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a0bae-0b6f-4a80-bdcf-ebe718ed99e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:01.834657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a0bae-0b6f-4a80-bdcf-ebe718ed99e3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.835173 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a0bae-0b6f-4a80-bdcf-ebe718ed99e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.835666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a0bae-0b6f-4a80-bdcf-ebe718ed99e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a0bae-0b6f-4a80-bdcf-ebe718ed99e3 None admin] RBAC: Adding query filter params (interface=public, service_id=1b746cc8a19f4375b5e74f6316d4d44b, region_id=RegionOne) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:01.837119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a0bae-0b6f-4a80-bdcf-ebe718ed99e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.838722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a0bae-0b6f-4a80-bdcf-ebe718ed99e3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.845844 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 450/910] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/endpoints?service_id=1b746cc8a19f4375b5e74f6316d4d44b&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:01.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab098187-db9c-4d89-90a1-e37e1a7cce72 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.935841 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a0bae-0b6f-4a80-bdcf-ebe718ed99e3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.972846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab098187-db9c-4d89-90a1-e37e1a7cce72 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:02.018679 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7ef6f-298c-470e-b34e-0762a8acaba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:02.019947 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ef6f-298c-470e-b34e-0762a8acaba2 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:02.020944 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ef6f-298c-470e-b34e-0762a8acaba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:02.021376 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ef6f-298c-470e-b34e-0762a8acaba2 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:02.022136 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7ef6f-298c-470e-b34e-0762a8acaba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:02.023893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7ef6f-298c-470e-b34e-0762a8acaba2 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:02.031427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 461/911] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:44:02.061675 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a0bae-0b6f-4a80-bdcf-ebe718ed99e3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:02.099393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bafd4-6ef6-4100-bc2d-74d8a4d4adda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:02.100022 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bafd4-6ef6-4100-bc2d-74d8a4d4adda None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:02.100331 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bafd4-6ef6-4100-bc2d-74d8a4d4adda None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:02.100602 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bafd4-6ef6-4100-bc2d-74d8a4d4adda None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:02.101283 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bafd4-6ef6-4100-bc2d-74d8a4d4adda None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:02.102693 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bafd4-6ef6-4100-bc2d-74d8a4d4adda None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:02.120842 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 451/912] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:44:01 2022] POST /identity/v3/services => generated 241 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:44:02.281819 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546386-ac1d-4040-9876-b9f69fd5a76b None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:02.281997 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546386-ac1d-4040-9876-b9f69fd5a76b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:02.282259 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546386-ac1d-4040-9876-b9f69fd5a76b None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:02.283954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 462/913] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:02.289793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e6635-87c0-4ad3-97ca-00b54593a80a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:02.290113 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e6635-87c0-4ad3-97ca-00b54593a80a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:02.290340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e6635-87c0-4ad3-97ca-00b54593a80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:02.310963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5e4e6635-87c0-4ad3-97ca-00b54593a80a None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:02.312194 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5e4e6635-87c0-4ad3-97ca-00b54593a80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:02.322374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:02.389269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 452/914] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:02.657973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6546386-ac1d-4040-9876-b9f69fd5a76b None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:02.709932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:02.763962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6546386-ac1d-4040-9876-b9f69fd5a76b None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:02.799324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81530a52-f90e-4668-acdf-8f06d0d2130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:02.800015 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81530a52-f90e-4668-acdf-8f06d0d2130d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:02.800310 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81530a52-f90e-4668-acdf-8f06d0d2130d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:02.800623 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81530a52-f90e-4668-acdf-8f06d0d2130d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:02.810951 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81530a52-f90e-4668-acdf-8f06d0d2130d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-81530a52-f90e-4668-acdf-8f06d0d2130d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:02.815726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:02.816736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:02.817698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 463/915] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Oct 9 00:44:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:02.823290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e6635-87c0-4ad3-97ca-00b54593a80a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:02.928854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e6635-87c0-4ad3-97ca-00b54593a80a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:02.964626 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57773-73bd-433e-a8ea-fe4000e33a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:02.965239 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57773-73bd-433e-a8ea-fe4000e33a6b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:02.965516 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57773-73bd-433e-a8ea-fe4000e33a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:02.965792 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57773-73bd-433e-a8ea-fe4000e33a6b None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:02.966455 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57773-73bd-433e-a8ea-fe4000e33a6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:02.966756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57773-73bd-433e-a8ea-fe4000e33a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:02.968165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57773-73bd-433e-a8ea-fe4000e33a6b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:02.977169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 453/916] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Oct 9 00:44:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:02.982878 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81530a52-f90e-4668-acdf-8f06d0d2130d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:03.089126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81530a52-f90e-4668-acdf-8f06d0d2130d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:03.112432 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:03.126231 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05473f-0d55-41a2-a71a-add38e423ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:03.127002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05473f-0d55-41a2-a71a-add38e423ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:03.127271 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05473f-0d55-41a2-a71a-add38e423ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:03.127535 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05473f-0d55-41a2-a71a-add38e423ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:03.138667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05473f-0d55-41a2-a71a-add38e423ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:03.140123 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05473f-0d55-41a2-a71a-add38e423ee7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-ba05473f-0d55-41a2-a71a-add38e423ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:03.154734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:03.156667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:44:03.157873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:03.157873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:03.157873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:03.157873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 464/917] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:03.161658 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57773-73bd-433e-a8ea-fe4000e33a6b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:03.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:03.264703 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57773-73bd-433e-a8ea-fe4000e33a6b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:03.299549 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17e334-55d9-4879-b3a5-6201f4a0849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:03.300182 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17e334-55d9-4879-b3a5-6201f4a0849d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:03.300458 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17e334-55d9-4879-b3a5-6201f4a0849d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:03.300724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17e334-55d9-4879-b3a5-6201f4a0849d None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:03.301483 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17e334-55d9-4879-b3a5-6201f4a0849d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:03.301882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17e334-55d9-4879-b3a5-6201f4a0849d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:03.303266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17e334-55d9-4879-b3a5-6201f4a0849d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:03.315485 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 454/918] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:03.321324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05473f-0d55-41a2-a71a-add38e423ee7 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:03.428374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05473f-0d55-41a2-a71a-add38e423ee7 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:03.463879 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba63ed-e312-4ede-a909-b0c2954fc100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:03.464538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba63ed-e312-4ede-a909-b0c2954fc100 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:03.464808 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba63ed-e312-4ede-a909-b0c2954fc100 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:03.465065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba63ed-e312-4ede-a909-b0c2954fc100 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:03.472793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba63ed-e312-4ede-a909-b0c2954fc100 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:03.474312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba63ed-e312-4ede-a909-b0c2954fc100 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-05ba63ed-e312-4ede-a909-b0c2954fc100 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:44:03.486795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:03.487796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:03.489122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:03.489122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:03.489122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:44:03.489122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:44:03.489122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:44:03.489122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:44:03.489122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:44:03.489122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:44:03.489122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:44:03.489122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:03.489122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 465/919] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Oct 9 00:44:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:03.494300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17e334-55d9-4879-b3a5-6201f4a0849d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:03.560155 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:03.602362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17e334-55d9-4879-b3a5-6201f4a0849d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:03.638447 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e96eb-0e69-4b5c-a5cf-c17d164aa237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:03.639428 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e96eb-0e69-4b5c-a5cf-c17d164aa237 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:03.639906 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e96eb-0e69-4b5c-a5cf-c17d164aa237 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:03.640405 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e96eb-0e69-4b5c-a5cf-c17d164aa237 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:03.641368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e96eb-0e69-4b5c-a5cf-c17d164aa237 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:03.641872 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e96eb-0e69-4b5c-a5cf-c17d164aa237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:03.643517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e96eb-0e69-4b5c-a5cf-c17d164aa237 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:03.663393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 455/920] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Oct 9 00:44:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:03.668921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba63ed-e312-4ede-a909-b0c2954fc100 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:03.694806 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:03.776491 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba63ed-e312-4ede-a909-b0c2954fc100 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:03.811987 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe0c56-d151-47d5-a1f1-4e8cebcfa975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:03.812877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe0c56-d151-47d5-a1f1-4e8cebcfa975 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:03.813316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe0c56-d151-47d5-a1f1-4e8cebcfa975 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:03.813824 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe0c56-d151-47d5-a1f1-4e8cebcfa975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:03.824853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe0c56-d151-47d5-a1f1-4e8cebcfa975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:03.826451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe0c56-d151-47d5-a1f1-4e8cebcfa975 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-efbe0c56-d151-47d5-a1f1-4e8cebcfa975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:03.841482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:03.842722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:44:03.843925 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:03.843925 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:03.843925 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:03.845648 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 466/921] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:03.851579 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e96eb-0e69-4b5c-a5cf-c17d164aa237 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:03.960581 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e96eb-0e69-4b5c-a5cf-c17d164aa237 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:03.983238 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:03.998780 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d982d5-7993-40ee-9ca3-1d4f12f800ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:03.999404 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d982d5-7993-40ee-9ca3-1d4f12f800ea None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:03.999680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d982d5-7993-40ee-9ca3-1d4f12f800ea None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:03.999949 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d982d5-7993-40ee-9ca3-1d4f12f800ea None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.000620 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d982d5-7993-40ee-9ca3-1d4f12f800ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:04.000919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d982d5-7993-40ee-9ca3-1d4f12f800ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:04.002297 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d982d5-7993-40ee-9ca3-1d4f12f800ea None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:04.015119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 456/922] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:04.021180 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe0c56-d151-47d5-a1f1-4e8cebcfa975 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:04.063300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483536-1854-42bf-85e3-149134ee3482 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.063515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483536-1854-42bf-85e3-149134ee3482 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.063764 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483536-1854-42bf-85e3-149134ee3482 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.065412 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 457/923] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:04.070624 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02116549-3593-4ae5-9399-f5b2f3e07ca9 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.071176 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02116549-3593-4ae5-9399-f5b2f3e07ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.071664 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02116549-3593-4ae5-9399-f5b2f3e07ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.090226 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-02116549-3593-4ae5-9399-f5b2f3e07ca9 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:04.091897 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-02116549-3593-4ae5-9399-f5b2f3e07ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:04.112133 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:04.146349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe0c56-d151-47d5-a1f1-4e8cebcfa975 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:04.176348 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 458/924] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:44:04.185303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422f059-696e-48bf-a135-6a50b01a3176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:04.185941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422f059-696e-48bf-a135-6a50b01a3176 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.186215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422f059-696e-48bf-a135-6a50b01a3176 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.186483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422f059-696e-48bf-a135-6a50b01a3176 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.193581 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422f059-696e-48bf-a135-6a50b01a3176 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:04.195021 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422f059-696e-48bf-a135-6a50b01a3176 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-9422f059-696e-48bf-a135-6a50b01a3176 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:44:04.206380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:04.207406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:04.208523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:44:04.208523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:44:04.208523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:44:04.208523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:44:04.208523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:44:04.208523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:44:04.208523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:04.208523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:04.208523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 467/925] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:04.214051 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02116549-3593-4ae5-9399-f5b2f3e07ca9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:04.324345 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02116549-3593-4ae5-9399-f5b2f3e07ca9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:04.335509 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:04.335697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79ec9-749a-4a0b-a469-a3ae66e38135 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.335795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79ec9-749a-4a0b-a469-a3ae66e38135 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.336053 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79ec9-749a-4a0b-a469-a3ae66e38135 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.338767 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 468/926] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:44:04.342958 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cf2ae-91b7-4f63-9237-bc35bf5c545c None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.343228 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cf2ae-91b7-4f63-9237-bc35bf5c545c None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.343488 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cf2ae-91b7-4f63-9237-bc35bf5c545c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.366079 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274a847-9323-4e73-ae9c-12831efa2580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:04.366989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-0d4cf2ae-91b7-4f63-9237-bc35bf5c545c None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:04.367287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a847-9323-4e73-ae9c-12831efa2580 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.367766 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a847-9323-4e73-ae9c-12831efa2580 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.368186 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-0d4cf2ae-91b7-4f63-9237-bc35bf5c545c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:04.368488 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a847-9323-4e73-ae9c-12831efa2580 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.369359 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274a847-9323-4e73-ae9c-12831efa2580 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:04.369851 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274a847-9323-4e73-ae9c-12831efa2580 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:04.372660 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274a847-9323-4e73-ae9c-12831efa2580 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:04.389544 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 459/927] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:44:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:04.396107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274a847-9323-4e73-ae9c-12831efa2580 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:04.451889 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 469/928] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:04.464674 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cf2ae-91b7-4f63-9237-bc35bf5c545c None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:04.515517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274a847-9323-4e73-ae9c-12831efa2580 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:04.532793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:04.556220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008100d5-01e3-4849-84f1-41d81266ef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:04.556882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008100d5-01e3-4849-84f1-41d81266ef95 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.557161 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008100d5-01e3-4849-84f1-41d81266ef95 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.557437 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008100d5-01e3-4849-84f1-41d81266ef95 None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/7b36a416960d4106935476ef2b1682f6/roles/20ab666cb7654e36a5ca610eb516a482` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.559918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008100d5-01e3-4849-84f1-41d81266ef95 None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=7b36a416960d4106935476ef2b1682f6, role_id=20ab666cb7654e36a5ca610eb516a482)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:04.561401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008100d5-01e3-4849-84f1-41d81266ef95 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:04.574699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cf2ae-91b7-4f63-9237-bc35bf5c545c None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:04.578089 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 460/929] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:44:04 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/7b36a416960d4106935476ef2b1682f6/roles/20ab666cb7654e36a5ca610eb516a482 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:44:04.579297 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5be69-149f-4a37-b4bc-c42fa85df584 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.579554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5be69-149f-4a37-b4bc-c42fa85df584 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.579853 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5be69-149f-4a37-b4bc-c42fa85df584 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.584103 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 461/930] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:04.587922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f26f2a-cfcb-421a-890c-2f0b460d5ad7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.588247 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f26f2a-cfcb-421a-890c-2f0b460d5ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.588625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f26f2a-cfcb-421a-890c-2f0b460d5ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.608545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-80f26f2a-cfcb-421a-890c-2f0b460d5ad7 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:04.609863 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-80f26f2a-cfcb-421a-890c-2f0b460d5ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:04.626947 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c634085-8cce-400e-81ec-b8f22e1dbf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:04.627912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634085-8cce-400e-81ec-b8f22e1dbf07 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.628351 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634085-8cce-400e-81ec-b8f22e1dbf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.628896 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c634085-8cce-400e-81ec-b8f22e1dbf07 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.630455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c634085-8cce-400e-81ec-b8f22e1dbf07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:04.632923 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c634085-8cce-400e-81ec-b8f22e1dbf07 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:04.638914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-0c634085-8cce-400e-81ec-b8f22e1dbf07 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:04.649294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:04.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:44:04.651636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:04.656214 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 470/931] 10.222.0.43 () {56 vars in 1132 bytes} [Sun Oct 9 00:44:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:44:04.660443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c634085-8cce-400e-81ec-b8f22e1dbf07 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:04.706945 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 462/932] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:04.729842 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f26f2a-cfcb-421a-890c-2f0b460d5ad7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:04.788420 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c634085-8cce-400e-81ec-b8f22e1dbf07 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:04.823518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:04.833659 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467b552-9feb-4f2b-bcad-ea3116088d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:04.834303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467b552-9feb-4f2b-bcad-ea3116088d95 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.834582 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467b552-9feb-4f2b-bcad-ea3116088d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.834851 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467b552-9feb-4f2b-bcad-ea3116088d95 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.835469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467b552-9feb-4f2b-bcad-ea3116088d95 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:04.835766 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467b552-9feb-4f2b-bcad-ea3116088d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:04.837156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467b552-9feb-4f2b-bcad-ea3116088d95 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:04.842607 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 471/933] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Oct 9 00:44:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:04.848352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467b552-9feb-4f2b-bcad-ea3116088d95 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:04.855334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f26f2a-cfcb-421a-890c-2f0b460d5ad7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:04.892980 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0283da5-fb9e-4e00-be36-20d81c1a3c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:04.893607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0283da5-fb9e-4e00-be36-20d81c1a3c68 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.893877 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0283da5-fb9e-4e00-be36-20d81c1a3c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.894157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0283da5-fb9e-4e00-be36-20d81c1a3c68 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.894714 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0283da5-fb9e-4e00-be36-20d81c1a3c68 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:04.896517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0283da5-fb9e-4e00-be36-20d81c1a3c68 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-d0283da5-fb9e-4e00-be36-20d81c1a3c68 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:04.906913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:04.907985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:04.908934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 463/934] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:44:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:44:04.914188 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0283da5-fb9e-4e00-be36-20d81c1a3c68 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:04.959280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:04.980570 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467b552-9feb-4f2b-bcad-ea3116088d95 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:05.023354 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e46802-858a-46e7-a32f-0687b1754469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:05.023988 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e46802-858a-46e7-a32f-0687b1754469 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:05.024327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e46802-858a-46e7-a32f-0687b1754469 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:05.024590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e46802-858a-46e7-a32f-0687b1754469 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:05.025204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e46802-858a-46e7-a32f-0687b1754469 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:05.025515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e46802-858a-46e7-a32f-0687b1754469 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:05.026824 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e46802-858a-46e7-a32f-0687b1754469 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:05.036842 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 472/935] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Oct 9 00:44:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:05.036842 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e46802-858a-46e7-a32f-0687b1754469 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:05.039632 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0283da5-fb9e-4e00-be36-20d81c1a3c68 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:05.078507 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dd7a5-6ea6-48af-82b4-f59f46fee14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:05.079244 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dd7a5-6ea6-48af-82b4-f59f46fee14d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:05.079583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dd7a5-6ea6-48af-82b4-f59f46fee14d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:05.080002 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dd7a5-6ea6-48af-82b4-f59f46fee14d None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:05.080715 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dd7a5-6ea6-48af-82b4-f59f46fee14d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:05.081074 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dd7a5-6ea6-48af-82b4-f59f46fee14d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:05.082670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dd7a5-6ea6-48af-82b4-f59f46fee14d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:05.096306 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 464/936] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:44:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:05.096306 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dd7a5-6ea6-48af-82b4-f59f46fee14d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:05.101622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:05.149181 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e46802-858a-46e7-a32f-0687b1754469 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:05.183509 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d0783-2cb3-4de1-bbfa-fce299865aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:05.184402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d0783-2cb3-4de1-bbfa-fce299865aab None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:05.184779 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d0783-2cb3-4de1-bbfa-fce299865aab None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:05.185114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d0783-2cb3-4de1-bbfa-fce299865aab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:05.185755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d0783-2cb3-4de1-bbfa-fce299865aab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:05.187244 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d0783-2cb3-4de1-bbfa-fce299865aab None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:05.190275 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-e03d0783-2cb3-4de1-bbfa-fce299865aab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:05.196904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:05.198159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:05.199029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 473/937] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Oct 9 00:44:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:05.199899 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d0783-2cb3-4de1-bbfa-fce299865aab None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:05.210161 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dd7a5-6ea6-48af-82b4-f59f46fee14d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:05.245256 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f664e6e-5d42-4f48-af3d-a5fedd0ec71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:05.246010 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664e6e-5d42-4f48-af3d-a5fedd0ec71c None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:05.246382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664e6e-5d42-4f48-af3d-a5fedd0ec71c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:05.246660 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f664e6e-5d42-4f48-af3d-a5fedd0ec71c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:05.247320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f664e6e-5d42-4f48-af3d-a5fedd0ec71c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:05.248743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f664e6e-5d42-4f48-af3d-a5fedd0ec71c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:05.270668 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 465/938] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:44:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:05.271510 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f664e6e-5d42-4f48-af3d-a5fedd0ec71c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:05.324178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d0783-2cb3-4de1-bbfa-fce299865aab None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:05.348549 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:05.373708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7caf4d-b6d8-47eb-a1c6-d77327006c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:05.374731 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7caf4d-b6d8-47eb-a1c6-d77327006c47 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:05.375154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7caf4d-b6d8-47eb-a1c6-d77327006c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:05.375680 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7caf4d-b6d8-47eb-a1c6-d77327006c47 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:05.376551 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7caf4d-b6d8-47eb-a1c6-d77327006c47 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:05.377055 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7caf4d-b6d8-47eb-a1c6-d77327006c47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:05.378644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7caf4d-b6d8-47eb-a1c6-d77327006c47 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:05.386268 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 474/939] 10.222.0.43 () {56 vars in 1114 bytes} [Sun Oct 9 00:44:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:05.391962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7caf4d-b6d8-47eb-a1c6-d77327006c47 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:05.414306 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f664e6e-5d42-4f48-af3d-a5fedd0ec71c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:05.464578 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789fe36-7f57-480e-b6a0-13bef1a777ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:05.465226 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789fe36-7f57-480e-b6a0-13bef1a777ba None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:05.465734 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789fe36-7f57-480e-b6a0-13bef1a777ba None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:05.466007 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789fe36-7f57-480e-b6a0-13bef1a777ba None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:05.466638 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789fe36-7f57-480e-b6a0-13bef1a777ba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:05.466937 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789fe36-7f57-480e-b6a0-13bef1a777ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:05.469084 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789fe36-7f57-480e-b6a0-13bef1a777ba None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:05.475805 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 466/940] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Oct 9 00:44:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:05.481419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789fe36-7f57-480e-b6a0-13bef1a777ba None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:05.493224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:05.524434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7caf4d-b6d8-47eb-a1c6-d77327006c47 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:05.568496 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6ce67-9af7-4dd1-98c3-eaf0ddc4aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:05.569832 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ce67-9af7-4dd1-98c3-eaf0ddc4aea7 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:05.570259 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ce67-9af7-4dd1-98c3-eaf0ddc4aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:05.570675 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ce67-9af7-4dd1-98c3-eaf0ddc4aea7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:05.571860 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6ce67-9af7-4dd1-98c3-eaf0ddc4aea7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:05.574091 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6ce67-9af7-4dd1-98c3-eaf0ddc4aea7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:05.598523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789fe36-7f57-480e-b6a0-13bef1a777ba None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:05.602041 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 475/941] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:44:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:44:05.648782 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1173-890d-4e51-9943-2d0d2df74794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:05.649402 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1173-890d-4e51-9943-2d0d2df74794 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:05.649678 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1173-890d-4e51-9943-2d0d2df74794 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:05.649949 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd1173-890d-4e51-9943-2d0d2df74794 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:05.650624 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd1173-890d-4e51-9943-2d0d2df74794 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:05.650978 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd1173-890d-4e51-9943-2d0d2df74794 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:05.652430 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd1173-890d-4e51-9943-2d0d2df74794 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:05.658750 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 467/942] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Oct 9 00:44:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:05.665262 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6ce67-9af7-4dd1-98c3-eaf0ddc4aea7 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:05.732602 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:05.784941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6ce67-9af7-4dd1-98c3-eaf0ddc4aea7 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:05.822129 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0433f4-048c-4175-ba54-5689de1ed223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:05.822785 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0433f4-048c-4175-ba54-5689de1ed223 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:05.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0433f4-048c-4175-ba54-5689de1ed223 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:05.823228 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0433f4-048c-4175-ba54-5689de1ed223 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:05.823944 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0433f4-048c-4175-ba54-5689de1ed223 None admin] RBAC: Adding query filter params (interface=public, service_id=5920a9a2c0814749965664bbd192691c, region_id=RegionOne) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:05.824256 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0433f4-048c-4175-ba54-5689de1ed223 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:05.825615 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0433f4-048c-4175-ba54-5689de1ed223 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:05.831378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 476/943] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Oct 9 00:44:05 2022] GET /identity/v3/endpoints?service_id=5920a9a2c0814749965664bbd192691c&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:05.837407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1173-890d-4e51-9943-2d0d2df74794 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:05.910263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:05.946013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd1173-890d-4e51-9943-2d0d2df74794 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:05.981080 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca095cb-52c1-4c62-aaa6-e7e4eee30fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:05.981692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca095cb-52c1-4c62-aaa6-e7e4eee30fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:05.981965 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca095cb-52c1-4c62-aaa6-e7e4eee30fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:05.982233 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca095cb-52c1-4c62-aaa6-e7e4eee30fb7 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:05.982892 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca095cb-52c1-4c62-aaa6-e7e4eee30fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:05.984339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca095cb-52c1-4c62-aaa6-e7e4eee30fb7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:05.990924 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 468/944] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Oct 9 00:44:05 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:44:06.862590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05718-de42-4df8-9bbc-7f6ca62b3d34 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:06.863109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05718-de42-4df8-9bbc-7f6ca62b3d34 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:06.863109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05718-de42-4df8-9bbc-7f6ca62b3d34 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:06.864928 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 477/945] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:06.870217 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9558d-9c50-4d7b-a5d4-e08a8c26116f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:06.870502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9558d-9c50-4d7b-a5d4-e08a8c26116f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:06.870773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9558d-9c50-4d7b-a5d4-e08a8c26116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:06.890877 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b2e9558d-9c50-4d7b-a5d4-e08a8c26116f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:06.892207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b2e9558d-9c50-4d7b-a5d4-e08a8c26116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:06.963632 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 469/946] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:07.228070 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf05718-de42-4df8-9bbc-7f6ca62b3d34 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:07.331234 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:07.336414 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf05718-de42-4df8-9bbc-7f6ca62b3d34 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:07.371393 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de1ec4-4f34-4cb4-86e7-4f99fab81232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:07.372423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de1ec4-4f34-4cb4-86e7-4f99fab81232 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.372900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de1ec4-4f34-4cb4-86e7-4f99fab81232 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.373381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de1ec4-4f34-4cb4-86e7-4f99fab81232 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.385044 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de1ec4-4f34-4cb4-86e7-4f99fab81232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-19de1ec4-4f34-4cb4-86e7-4f99fab81232 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:07.390061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:07.391215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:44:07.392116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:07.394783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 478/947] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Oct 9 00:44:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:07.400608 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9558d-9c50-4d7b-a5d4-e08a8c26116f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:07.469977 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:07.512969 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9558d-9c50-4d7b-a5d4-e08a8c26116f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:07.545576 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c03e6-e5a8-450a-98f2-081e0d8070e6 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.545938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c03e6-e5a8-450a-98f2-081e0d8070e6 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.546279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c03e6-e5a8-450a-98f2-081e0d8070e6 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.548068 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 479/948] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:44:07.553356 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f90201-8f55-4e04-90b2-dfed0e91cc17 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.553636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f90201-8f55-4e04-90b2-dfed0e91cc17 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.553909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f90201-8f55-4e04-90b2-dfed0e91cc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.556311 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47363266-b97c-40a1-91ef-b307333572e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:07.557280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47363266-b97c-40a1-91ef-b307333572e5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.557860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47363266-b97c-40a1-91ef-b307333572e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.558320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47363266-b97c-40a1-91ef-b307333572e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.559257 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47363266-b97c-40a1-91ef-b307333572e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:07.559746 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47363266-b97c-40a1-91ef-b307333572e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:07.561532 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47363266-b97c-40a1-91ef-b307333572e5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:07.570776 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 470/949] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Oct 9 00:44:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:07.575846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-92f90201-8f55-4e04-90b2-dfed0e91cc17 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:07.577068 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-92f90201-8f55-4e04-90b2-dfed0e91cc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:07.577952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47363266-b97c-40a1-91ef-b307333572e5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:07.660468 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 480/950] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:07.688026 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47363266-b97c-40a1-91ef-b307333572e5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:07.712599 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:07.724680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45107bcc-05e2-4773-921a-9cd3cecf4171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:07.725514 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107bcc-05e2-4773-921a-9cd3cecf4171 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.725957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107bcc-05e2-4773-921a-9cd3cecf4171 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.726370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107bcc-05e2-4773-921a-9cd3cecf4171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.737587 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45107bcc-05e2-4773-921a-9cd3cecf4171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:07.739346 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45107bcc-05e2-4773-921a-9cd3cecf4171 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-45107bcc-05e2-4773-921a-9cd3cecf4171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:07.754221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:07.755596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:44:07.757131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:07.757131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:07.757131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:07.758957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 471/951] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:07.765093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f90201-8f55-4e04-90b2-dfed0e91cc17 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:07.864504 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:07.874564 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f90201-8f55-4e04-90b2-dfed0e91cc17 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:07.894143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697af426-2790-485c-98c7-b00a6eac4cfb None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.894422 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697af426-2790-485c-98c7-b00a6eac4cfb None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.894696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697af426-2790-485c-98c7-b00a6eac4cfb None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.896358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 472/952] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:07.903416 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436c34-4c8d-4de6-b09d-eb61da1208e0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.903690 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436c34-4c8d-4de6-b09d-eb61da1208e0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.903958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436c34-4c8d-4de6-b09d-eb61da1208e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.913590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399d977-e656-4bae-b8dd-c737a9763f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:07.914207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399d977-e656-4bae-b8dd-c737a9763f47 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.914479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399d977-e656-4bae-b8dd-c737a9763f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.914746 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399d977-e656-4bae-b8dd-c737a9763f47 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.915382 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399d977-e656-4bae-b8dd-c737a9763f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:07.915676 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399d977-e656-4bae-b8dd-c737a9763f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:07.917304 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399d977-e656-4bae-b8dd-c737a9763f47 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:07.922759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-74436c34-4c8d-4de6-b09d-eb61da1208e0 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:07.924169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-74436c34-4c8d-4de6-b09d-eb61da1208e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:07.930432 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 481/953] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:07.935901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399d977-e656-4bae-b8dd-c737a9763f47 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:08.000142 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 473/954] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:44:08.001013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74436c34-4c8d-4de6-b09d-eb61da1208e0 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:08.043749 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399d977-e656-4bae-b8dd-c737a9763f47 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:08.080473 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea770-0e74-4c0b-a663-067930c8d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:08.081524 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea770-0e74-4c0b-a663-067930c8d24f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:08.081882 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea770-0e74-4c0b-a663-067930c8d24f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:08.082222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea770-0e74-4c0b-a663-067930c8d24f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:08.090568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ea770-0e74-4c0b-a663-067930c8d24f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:08.092176 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ea770-0e74-4c0b-a663-067930c8d24f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-085ea770-0e74-4c0b-a663-067930c8d24f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:44:08.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:08.105331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:08.106303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:08.106303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:08.106303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:44:08.106303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:44:08.106303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:44:08.106303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:44:08.106303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:44:08.106303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:44:08.106303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:44:08.106303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:08.110276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 482/955] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Oct 9 00:44:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:44:08.111128 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea770-0e74-4c0b-a663-067930c8d24f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:08.117319 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74436c34-4c8d-4de6-b09d-eb61da1208e0 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:08.124498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:08.127874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:08.163614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189632b-7498-4c13-8221-c6517d516253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:08.164793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189632b-7498-4c13-8221-c6517d516253 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:08.165290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189632b-7498-4c13-8221-c6517d516253 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:08.165773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189632b-7498-4c13-8221-c6517d516253 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:08.166553 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189632b-7498-4c13-8221-c6517d516253 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:08.168322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189632b-7498-4c13-8221-c6517d516253 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-5189632b-7498-4c13-8221-c6517d516253 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:08.178373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:08.179432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:44:08.180373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:08.188376 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 474/956] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:44:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:08.189483 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189632b-7498-4c13-8221-c6517d516253 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:08.220345 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea770-0e74-4c0b-a663-067930c8d24f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:08.257339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455470c6-3897-4bbe-93d4-8a87d3bf188d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:08.257955 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455470c6-3897-4bbe-93d4-8a87d3bf188d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:08.258232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455470c6-3897-4bbe-93d4-8a87d3bf188d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:08.258500 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455470c6-3897-4bbe-93d4-8a87d3bf188d None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:08.259320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455470c6-3897-4bbe-93d4-8a87d3bf188d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:08.259748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455470c6-3897-4bbe-93d4-8a87d3bf188d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:08.261272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455470c6-3897-4bbe-93d4-8a87d3bf188d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:08.283560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 483/957] 10.222.0.43 () {56 vars in 1149 bytes} [Sun Oct 9 00:44:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:08.285599 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d73e51-4e7e-4b1f-9598-a5f19eb94eb3 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:08.285965 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d73e51-4e7e-4b1f-9598-a5f19eb94eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:08.287618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d73e51-4e7e-4b1f-9598-a5f19eb94eb3 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:08.287795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 484/958] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:08.288504 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d73e51-4e7e-4b1f-9598-a5f19eb94eb3 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:08.304249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189632b-7498-4c13-8221-c6517d516253 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:08.337363 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3768-5651-422e-bd8d-c6ff1cfbd5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:08.337966 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3768-5651-422e-bd8d-c6ff1cfbd5fa None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:08.338239 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3768-5651-422e-bd8d-c6ff1cfbd5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:08.338507 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3768-5651-422e-bd8d-c6ff1cfbd5fa None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:08.339124 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f3768-5651-422e-bd8d-c6ff1cfbd5fa None admin] RBAC: Adding query filter params (name=compute) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:08.339422 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f3768-5651-422e-bd8d-c6ff1cfbd5fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:08.340828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f3768-5651-422e-bd8d-c6ff1cfbd5fa None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:08.345424 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 475/959] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:44:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:08.346195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3768-5651-422e-bd8d-c6ff1cfbd5fa None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:08.358097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:08.380484 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:08.393726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d73e51-4e7e-4b1f-9598-a5f19eb94eb3 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:08.427944 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e31ce-6658-4dff-807b-5aa4fea846ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:08.428580 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e31ce-6658-4dff-807b-5aa4fea846ca None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:08.428853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e31ce-6658-4dff-807b-5aa4fea846ca None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:08.429121 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e31ce-6658-4dff-807b-5aa4fea846ca None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:08.429757 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e31ce-6658-4dff-807b-5aa4fea846ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:08.431178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e31ce-6658-4dff-807b-5aa4fea846ca None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:08.433820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: WARNING keystone.server.flask.common [None req-015e31ce-6658-4dff-807b-5aa4fea846ca None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 09 00:44:08.446877 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3768-5651-422e-bd8d-c6ff1cfbd5fa None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:08.450795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.sql.core [None req-015e31ce-6658-4dff-807b-5aa4fea846ca None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 09 00:44:08.450795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 09 00:44:08.450795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [parameters: {'id': '6609c312dbac496894b678f57f3e36bd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 09 00:44:08.450795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81520) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-015e31ce-6658-4dff-807b-5aa4fea846ca None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6609c312dbac496894b678f57f3e36bd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6609c312dbac496894b678f57f3e36bd. Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:44:08.467417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application result.read() Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 09 00:44:08.468375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application yield resource Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self.session.rollback() Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self.force_reraise() Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise self.value Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application session.commit() Oct 09 00:44:08.469392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._prepare_impl() Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self.session.flush() Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._flush(objects) Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application compat.raise_( Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application flush_context.execute() Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 09 00:44:08.470362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rec.execute(self) Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 09 00:44:08.471320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application result.read() Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:44:08.472298 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [parameters: {'id': '6609c312dbac496894b678f57f3e36bd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:08.473252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:08.476098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6609c312dbac496894b678f57f3e36bd. Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 485/960] 10.222.0.43 () {60 vars in 1140 bytes} [Sun Oct 9 00:44:08 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0db4f0-dc8d-4296-8b3c-c5db85085e77 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:08.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0db4f0-dc8d-4296-8b3c-c5db85085e77 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:08.479216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0db4f0-dc8d-4296-8b3c-c5db85085e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:08.484929 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003337a-a9d2-455e-be4d-d1e28d592b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:08.485541 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003337a-a9d2-455e-be4d-d1e28d592b60 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:08.485816 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003337a-a9d2-455e-be4d-d1e28d592b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:08.486132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003337a-a9d2-455e-be4d-d1e28d592b60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:08.489985 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-5f0db4f0-dc8d-4296-8b3c-c5db85085e77 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:08.491512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-5f0db4f0-dc8d-4296-8b3c-c5db85085e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:08.555773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003337a-a9d2-455e-be4d-d1e28d592b60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:08.557246 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003337a-a9d2-455e-be4d-d1e28d592b60 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:08.562126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 486/961] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:08.562963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0db4f0-dc8d-4296-8b3c-c5db85085e77 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:08.593156 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:08.636751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:08.662331 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 476/962] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:08 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:08.663231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003337a-a9d2-455e-be4d-d1e28d592b60 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:08.691265 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0db4f0-dc8d-4296-8b3c-c5db85085e77 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:08.725999 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a68a1-e51a-4184-8bdb-306341d9abb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:08.726605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a68a1-e51a-4184-8bdb-306341d9abb0 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:08.726877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a68a1-e51a-4184-8bdb-306341d9abb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:08.727141 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a68a1-e51a-4184-8bdb-306341d9abb0 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:08.727755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a68a1-e51a-4184-8bdb-306341d9abb0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:08.728070 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a68a1-e51a-4184-8bdb-306341d9abb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:08.729631 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a68a1-e51a-4184-8bdb-306341d9abb0 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:08.737740 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 487/963] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:44:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:08.738543 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a68a1-e51a-4184-8bdb-306341d9abb0 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:08.793761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003337a-a9d2-455e-be4d-d1e28d592b60 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:08.833998 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd892369-c91b-419e-b074-331a6fcc4fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:08.834644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd892369-c91b-419e-b074-331a6fcc4fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:08.834923 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd892369-c91b-419e-b074-331a6fcc4fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:08.835188 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd892369-c91b-419e-b074-331a6fcc4fe0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:08.837623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:08.843976 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd892369-c91b-419e-b074-331a6fcc4fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:08.847061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd892369-c91b-419e-b074-331a6fcc4fe0 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-cd892369-c91b-419e-b074-331a6fcc4fe0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:44:08.861038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:08.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:08.863479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:44:08.863479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:44:08.863479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:44:08.863479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:44:08.863479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:44:08.863479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:44:08.863479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:08.863479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:08.863479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 477/964] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:08.863479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd892369-c91b-419e-b074-331a6fcc4fe0 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:08.881977 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a68a1-e51a-4184-8bdb-306341d9abb0 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:08.902409 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:08.921931 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c567-2a9b-44ea-b417-7bf3b0d59abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:08.922573 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c567-2a9b-44ea-b417-7bf3b0d59abe None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:08.922846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c567-2a9b-44ea-b417-7bf3b0d59abe None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:08.923112 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c567-2a9b-44ea-b417-7bf3b0d59abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:08.935471 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4c567-2a9b-44ea-b417-7bf3b0d59abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:08.936939 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4c567-2a9b-44ea-b417-7bf3b0d59abe None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-f4b4c567-2a9b-44ea-b417-7bf3b0d59abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:08.955327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:08.956644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:44:08.957804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:08.957804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:08.957804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:08.960260 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 488/965] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:08.961382 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c567-2a9b-44ea-b417-7bf3b0d59abe None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:08.974422 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd892369-c91b-419e-b074-331a6fcc4fe0 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:09.007464 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a2ecd-13e4-4e6e-bcf8-2d3d948384c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:09.008189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2ecd-13e4-4e6e-bcf8-2d3d948384c2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:09.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2ecd-13e4-4e6e-bcf8-2d3d948384c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:09.008648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2ecd-13e4-4e6e-bcf8-2d3d948384c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:09.009227 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a2ecd-13e4-4e6e-bcf8-2d3d948384c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:09.010603 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a2ecd-13e4-4e6e-bcf8-2d3d948384c2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-d90a2ecd-13e4-4e6e-bcf8-2d3d948384c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:09.020062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:09.021218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:09.022139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 478/966] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Oct 9 00:44:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:09.022970 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a2ecd-13e4-4e6e-bcf8-2d3d948384c2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:09.071114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c567-2a9b-44ea-b417-7bf3b0d59abe None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:09.086212 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:09.108935 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2660e2-96de-4e34-880c-7780bb2f259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:09.109792 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2660e2-96de-4e34-880c-7780bb2f259c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:09.110095 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2660e2-96de-4e34-880c-7780bb2f259c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:09.110307 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2660e2-96de-4e34-880c-7780bb2f259c None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:09.111125 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2660e2-96de-4e34-880c-7780bb2f259c None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:09.111250 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2660e2-96de-4e34-880c-7780bb2f259c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:09.112693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2660e2-96de-4e34-880c-7780bb2f259c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:09.129990 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a2ecd-13e4-4e6e-bcf8-2d3d948384c2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:09.140206 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 489/967] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:44:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:09.140206 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2660e2-96de-4e34-880c-7780bb2f259c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:09.174616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:09.183464 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099a010-1b69-45bd-9fab-2c21fb75d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:09.184257 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099a010-1b69-45bd-9fab-2c21fb75d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:09.184538 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099a010-1b69-45bd-9fab-2c21fb75d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:09.184802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099a010-1b69-45bd-9fab-2c21fb75d5b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:09.185446 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099a010-1b69-45bd-9fab-2c21fb75d5b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:09.185744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099a010-1b69-45bd-9fab-2c21fb75d5b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:09.187152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099a010-1b69-45bd-9fab-2c21fb75d5b9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:09.204647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 479/968] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:09.210573 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099a010-1b69-45bd-9fab-2c21fb75d5b9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:09.269757 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2660e2-96de-4e34-880c-7780bb2f259c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:09.311005 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe3700-4aa2-4e01-a3d8-bb1bdd64f503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:09.311696 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe3700-4aa2-4e01-a3d8-bb1bdd64f503 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:09.311973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe3700-4aa2-4e01-a3d8-bb1bdd64f503 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:09.312313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe3700-4aa2-4e01-a3d8-bb1bdd64f503 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:09.313053 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe3700-4aa2-4e01-a3d8-bb1bdd64f503 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:09.313531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe3700-4aa2-4e01-a3d8-bb1bdd64f503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:09.315362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe3700-4aa2-4e01-a3d8-bb1bdd64f503 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:09.321466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 490/969] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Oct 9 00:44:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:09.328098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe3700-4aa2-4e01-a3d8-bb1bdd64f503 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:09.351396 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099a010-1b69-45bd-9fab-2c21fb75d5b9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:09.372653 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:09.395903 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315acc7-158d-4be3-aeb5-655f91baab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:09.396653 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315acc7-158d-4be3-aeb5-655f91baab19 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:09.396925 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315acc7-158d-4be3-aeb5-655f91baab19 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:09.397189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315acc7-158d-4be3-aeb5-655f91baab19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:09.404633 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315acc7-158d-4be3-aeb5-655f91baab19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:09.406245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315acc7-158d-4be3-aeb5-655f91baab19 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-1315acc7-158d-4be3-aeb5-655f91baab19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:44:09.418081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:09.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:09.420253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:44:09.420253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:44:09.420253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:44:09.420253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:44:09.420253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:44:09.420253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:44:09.420253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:09.420253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:09.420253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 480/970] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:09.429078 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315acc7-158d-4be3-aeb5-655f91baab19 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:09.460017 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:09.468949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe3700-4aa2-4e01-a3d8-bb1bdd64f503 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:09.513682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0ad6-dcdf-47ea-9c23-9b0708876ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:09.514295 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0ad6-dcdf-47ea-9c23-9b0708876ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:09.514568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0ad6-dcdf-47ea-9c23-9b0708876ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:09.514833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0ad6-dcdf-47ea-9c23-9b0708876ac8 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:09.516110 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0ad6-dcdf-47ea-9c23-9b0708876ac8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:09.516418 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0ad6-dcdf-47ea-9c23-9b0708876ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:09.517782 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0ad6-dcdf-47ea-9c23-9b0708876ac8 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:09.529353 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 491/971] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Oct 9 00:44:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:09.534199 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0ad6-dcdf-47ea-9c23-9b0708876ac8 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:09.551796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315acc7-158d-4be3-aeb5-655f91baab19 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:09.588621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cce4a3-1c1c-43e0-b783-71d342a1b215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:09.589639 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cce4a3-1c1c-43e0-b783-71d342a1b215 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:09.590131 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cce4a3-1c1c-43e0-b783-71d342a1b215 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:09.590604 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cce4a3-1c1c-43e0-b783-71d342a1b215 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:09.591607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cce4a3-1c1c-43e0-b783-71d342a1b215 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:09.592146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cce4a3-1c1c-43e0-b783-71d342a1b215 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:09.594718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cce4a3-1c1c-43e0-b783-71d342a1b215 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:09.614316 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 481/972] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:09.616476 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cce4a3-1c1c-43e0-b783-71d342a1b215 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:09.645230 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0ad6-dcdf-47ea-9c23-9b0708876ac8 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:09.663253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:09.685253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84bdb6-667e-47de-9195-04d0e56a2281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:09.686168 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84bdb6-667e-47de-9195-04d0e56a2281 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:09.686453 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84bdb6-667e-47de-9195-04d0e56a2281 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:09.686717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84bdb6-667e-47de-9195-04d0e56a2281 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:09.687929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84bdb6-667e-47de-9195-04d0e56a2281 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:09.689319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84bdb6-667e-47de-9195-04d0e56a2281 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:09.716070 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 492/973] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:44:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:09.744213 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cce4a3-1c1c-43e0-b783-71d342a1b215 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:09.790549 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50225de8-0809-4a32-9d25-9d02ed158f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:09.790549 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50225de8-0809-4a32-9d25-9d02ed158f30 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:09.790549 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50225de8-0809-4a32-9d25-9d02ed158f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:09.790949 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50225de8-0809-4a32-9d25-9d02ed158f30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:09.791591 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50225de8-0809-4a32-9d25-9d02ed158f30 None admin] RBAC: Adding query filter params (role.id=20ab666cb7654e36a5ca610eb516a482, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=7b36a416960d4106935476ef2b1682f6) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:09.791955 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50225de8-0809-4a32-9d25-9d02ed158f30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:09.793740 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50225de8-0809-4a32-9d25-9d02ed158f30 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:09.808535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 482/974] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:09 2022] GET /identity/v3/role_assignments?user.id=7b36a416960d4106935476ef2b1682f6&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=20ab666cb7654e36a5ca610eb516a482 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:10.925400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cb34f-7e25-4de4-bd5b-2bfe0d4a5286 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:10.925935 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cb34f-7e25-4de4-bd5b-2bfe0d4a5286 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:10.925935 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cb34f-7e25-4de4-bd5b-2bfe0d4a5286 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:10.927719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 493/975] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:10.933452 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef91f4-b66d-4ddc-94f8-24508da27a63 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:10.934435 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef91f4-b66d-4ddc-94f8-24508da27a63 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:10.934936 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef91f4-b66d-4ddc-94f8-24508da27a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:10.953664 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bbef91f4-b66d-4ddc-94f8-24508da27a63 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:10.955204 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bbef91f4-b66d-4ddc-94f8-24508da27a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:11.026136 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 483/976] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:11.292606 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cb34f-7e25-4de4-bd5b-2bfe0d4a5286 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:11.310829 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:11.407393 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cb34f-7e25-4de4-bd5b-2bfe0d4a5286 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:11.432229 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bafbb-a28b-4eab-8594-f01677aafa7a None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:11.432537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bafbb-a28b-4eab-8594-f01677aafa7a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:11.432775 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bafbb-a28b-4eab-8594-f01677aafa7a None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:11.434403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 484/977] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:11.439828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a66a71-e110-4b1b-aca5-e1915072ff09 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:11.440237 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a66a71-e110-4b1b-aca5-e1915072ff09 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:11.440514 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a66a71-e110-4b1b-aca5-e1915072ff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:11.442527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb081f6-8318-4705-8904-b97a322e8b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:11.443151 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb081f6-8318-4705-8904-b97a322e8b3a None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:11.443422 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb081f6-8318-4705-8904-b97a322e8b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:11.443689 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb081f6-8318-4705-8904-b97a322e8b3a None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:11.444499 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb081f6-8318-4705-8904-b97a322e8b3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:11.445853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb081f6-8318-4705-8904-b97a322e8b3a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:11.460178 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-60a66a71-e110-4b1b-aca5-e1915072ff09 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:11.461499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-60a66a71-e110-4b1b-aca5-e1915072ff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:11.465219 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 494/978] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:44:11 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:11.490195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:11.553490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 485/979] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:44:11.821977 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb081f6-8318-4705-8904-b97a322e8b3a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:11.907135 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:11.942086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb081f6-8318-4705-8904-b97a322e8b3a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:11.979509 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cecbb9-cb03-4560-b8f1-092916cd28c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:11.980146 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cecbb9-cb03-4560-b8f1-092916cd28c2 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:11.980425 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cecbb9-cb03-4560-b8f1-092916cd28c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:11.980752 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cecbb9-cb03-4560-b8f1-092916cd28c2 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:11.981421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cecbb9-cb03-4560-b8f1-092916cd28c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:11.982849 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cecbb9-cb03-4560-b8f1-092916cd28c2 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:11.998642 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.sql.core [None req-58cecbb9-cb03-4560-b8f1-092916cd28c2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 09 00:44:11.998642 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 09 00:44:11.998642 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [parameters: {'user_id': 'b3f24282a501451fa914acbcb2826b98', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 09 00:44:11.998642 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81520) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-58cecbb9-cb03-4560-b8f1-092916cd28c2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application result.read() Oct 09 00:44:12.007185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:44:12.008178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application yield resource Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self.session.rollback() Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self.force_reraise() Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise self.value Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application session.commit() Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 09 00:44:12.009197 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._prepare_impl() Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self.session.flush() Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._flush(objects) Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application compat.raise_( Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application flush_context.execute() Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rec.execute(self) Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 09 00:44:12.010807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:44:12.013083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application result.read() Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:44:12.015142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b3f24282a501451fa914acbcb2826b98', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:12.017279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 09 00:44:12.019193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 09 00:44:12.021712 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 09 00:44:12.021712 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 09 00:44:12.021712 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 09 00:44:12.021712 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 09 00:44:12.021712 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 09 00:44:12.021712 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:12.021712 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 495/980] 10.222.0.43 () {60 vars in 1131 bytes} [Sun Oct 9 00:44:11 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:12.030780 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a66a71-e110-4b1b-aca5-e1915072ff09 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:12.034734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabaccb-3cd0-4bff-b262-b245ec6e47fd None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:12.034734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabaccb-3cd0-4bff-b262-b245ec6e47fd None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:12.034734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabaccb-3cd0-4bff-b262-b245ec6e47fd None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:12.044934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 496/981] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:12 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:12.046978 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c370-adc9-44de-8cc0-0fdb11e455c5 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:12.047227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c370-adc9-44de-8cc0-0fdb11e455c5 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:12.047496 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c370-adc9-44de-8cc0-0fdb11e455c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:12.069070 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-f5b4c370-adc9-44de-8cc0-0fdb11e455c5 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:12.071494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-f5b4c370-adc9-44de-8cc0-0fdb11e455c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:12.145575 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a66a71-e110-4b1b-aca5-e1915072ff09 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:12.155413 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 497/982] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:12.165454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f5c3-3226-4710-b53d-73a9a091ee99 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:12.165857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f5c3-3226-4710-b53d-73a9a091ee99 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:12.166217 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f5c3-3226-4710-b53d-73a9a091ee99 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:12.167819 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 498/983] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:12.173220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f85f2-7d21-4b3e-ae5e-496579c06098 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:12.173578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f85f2-7d21-4b3e-ae5e-496579c06098 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:12.173928 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f85f2-7d21-4b3e-ae5e-496579c06098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:12.190603 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43aec-c2fd-46ce-81f1-f832f598bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:12.191578 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43aec-c2fd-46ce-81f1-f832f598bde3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:12.192199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43aec-c2fd-46ce-81f1-f832f598bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:12.192760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43aec-c2fd-46ce-81f1-f832f598bde3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:12.193740 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-b51f85f2-7d21-4b3e-ae5e-496579c06098 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:12.194987 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-b51f85f2-7d21-4b3e-ae5e-496579c06098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:12.201276 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde43aec-c2fd-46ce-81f1-f832f598bde3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:12.203016 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde43aec-c2fd-46ce-81f1-f832f598bde3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-cde43aec-c2fd-46ce-81f1-f832f598bde3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:44:12.215395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:12.216520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:12.217533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:12.217533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:12.217533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:44:12.217533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:44:12.217533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:44:12.217533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:44:12.217533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:44:12.217533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:44:12.217533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:44:12.217533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:12.220030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 486/984] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:12.229207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43aec-c2fd-46ce-81f1-f832f598bde3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:12.247126 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:12.265578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:12.277322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 499/985] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:12.337559 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43aec-c2fd-46ce-81f1-f832f598bde3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:12.372520 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d82d2-e044-48af-9f87-14c928ae1e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:12.373224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d82d2-e044-48af-9f87-14c928ae1e81 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:12.373570 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d82d2-e044-48af-9f87-14c928ae1e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:12.373909 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d82d2-e044-48af-9f87-14c928ae1e81 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:12.374722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d82d2-e044-48af-9f87-14c928ae1e81 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:12.375102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d82d2-e044-48af-9f87-14c928ae1e81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:12.376670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d82d2-e044-48af-9f87-14c928ae1e81 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:12.414005 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 487/986] 10.222.0.43 () {56 vars in 1101 bytes} [Sun Oct 9 00:44:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:12.441859 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f85f2-7d21-4b3e-ae5e-496579c06098 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:12.552828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d82d2-e044-48af-9f87-14c928ae1e81 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:12.555346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f85f2-7d21-4b3e-ae5e-496579c06098 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:12.591571 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b736282-5686-4b3b-b740-d5e2279a4ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:12.592659 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b736282-5686-4b3b-b740-d5e2279a4ece None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:12.593295 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b736282-5686-4b3b-b740-d5e2279a4ece None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:12.593759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b736282-5686-4b3b-b740-d5e2279a4ece None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:12.594557 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b736282-5686-4b3b-b740-d5e2279a4ece None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:12.596233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b736282-5686-4b3b-b740-d5e2279a4ece None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-5b736282-5686-4b3b-b740-d5e2279a4ece None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:12.605838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:12.607215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:12.608349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:12.610150 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 500/987] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Oct 9 00:44:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:12.616214 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b736282-5686-4b3b-b740-d5e2279a4ece None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:12.648563 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:12.690175 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:12.699665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d82d2-e044-48af-9f87-14c928ae1e81 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:12.742549 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a097689-9edb-4814-8438-16826a92293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:12.743189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a097689-9edb-4814-8438-16826a92293e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:12.743462 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a097689-9edb-4814-8438-16826a92293e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:12.743728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a097689-9edb-4814-8438-16826a92293e None admin] PATH_INFO: `/v3/services/image` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:12.744323 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b736282-5686-4b3b-b740-d5e2279a4ece None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:12.744448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a097689-9edb-4814-8438-16826a92293e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:12.745729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a097689-9edb-4814-8438-16826a92293e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-4a097689-9edb-4814-8438-16826a92293e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:12.754673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:12.756554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:12.757501 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 488/988] 10.222.0.43 () {56 vars in 1105 bytes} [Sun Oct 9 00:44:12 2022] GET /identity/v3/services/image => generated 86 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:44:12.762356 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a097689-9edb-4814-8438-16826a92293e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:12.789934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403de5c1-f3e2-4462-a05c-5ea09742ecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:12.790546 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403de5c1-f3e2-4462-a05c-5ea09742ecd5 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:12.790817 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403de5c1-f3e2-4462-a05c-5ea09742ecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:12.791081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403de5c1-f3e2-4462-a05c-5ea09742ecd5 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:12.791700 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403de5c1-f3e2-4462-a05c-5ea09742ecd5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:12.791984 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403de5c1-f3e2-4462-a05c-5ea09742ecd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:12.793408 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403de5c1-f3e2-4462-a05c-5ea09742ecd5 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:12.800198 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 501/989] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Oct 9 00:44:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:12.804581 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403de5c1-f3e2-4462-a05c-5ea09742ecd5 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:12.876283 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a097689-9edb-4814-8438-16826a92293e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:12.904955 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403de5c1-f3e2-4462-a05c-5ea09742ecd5 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:12.912519 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261c41d-813c-47b3-8896-96b795916642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:12.913207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261c41d-813c-47b3-8896-96b795916642 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:12.913538 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261c41d-813c-47b3-8896-96b795916642 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:12.913887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261c41d-813c-47b3-8896-96b795916642 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:12.914594 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261c41d-813c-47b3-8896-96b795916642 None admin] RBAC: Adding query filter params (name=image) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:12.914876 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261c41d-813c-47b3-8896-96b795916642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:12.916270 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261c41d-813c-47b3-8896-96b795916642 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:12.918467 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:12.927253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 489/990] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:12.927937 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261c41d-813c-47b3-8896-96b795916642 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:12.931200 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:12.944338 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd886c-7f43-4550-bab1-53dbe38f02c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:12.944941 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd886c-7f43-4550-bab1-53dbe38f02c8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:12.945227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd886c-7f43-4550-bab1-53dbe38f02c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:12.945467 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd886c-7f43-4550-bab1-53dbe38f02c8 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:12.946022 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd886c-7f43-4550-bab1-53dbe38f02c8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:12.946317 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd886c-7f43-4550-bab1-53dbe38f02c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:12.947678 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd886c-7f43-4550-bab1-53dbe38f02c8 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:12.958014 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 502/991] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Oct 9 00:44:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:12.958745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd886c-7f43-4550-bab1-53dbe38f02c8 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:13.037706 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261c41d-813c-47b3-8896-96b795916642 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:13.062125 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd886c-7f43-4550-bab1-53dbe38f02c8 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:13.073685 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e8455-dc59-4bb0-b49a-b3dd0671c143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:13.074419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e8455-dc59-4bb0-b49a-b3dd0671c143 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:13.074799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e8455-dc59-4bb0-b49a-b3dd0671c143 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:13.075167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e8455-dc59-4bb0-b49a-b3dd0671c143 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:13.075883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e8455-dc59-4bb0-b49a-b3dd0671c143 None admin] RBAC: Adding query filter params (type=image) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:13.076310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e8455-dc59-4bb0-b49a-b3dd0671c143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:13.077786 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e8455-dc59-4bb0-b49a-b3dd0671c143 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:13.082712 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 490/992] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:13.098651 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a844f-8920-4e10-8347-f1b93407a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:13.099480 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a844f-8920-4e10-8347-f1b93407a474 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:13.099674 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a844f-8920-4e10-8347-f1b93407a474 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:13.100346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a844f-8920-4e10-8347-f1b93407a474 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:13.101155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a844f-8920-4e10-8347-f1b93407a474 None admin] RBAC: Adding query filter params (interface=admin, service_id=5920a9a2c0814749965664bbd192691c, region_id=RegionOne) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:13.101155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a844f-8920-4e10-8347-f1b93407a474 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:13.102986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a844f-8920-4e10-8347-f1b93407a474 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:13.115361 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 503/993] 10.222.0.43 () {56 vars in 1249 bytes} [Sun Oct 9 00:44:12 2022] GET /identity/v3/endpoints?service_id=5920a9a2c0814749965664bbd192691c&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:13.116788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e8455-dc59-4bb0-b49a-b3dd0671c143 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:13.197535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:13.241239 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e8455-dc59-4bb0-b49a-b3dd0671c143 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:13.279063 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f4443-2144-4517-8b5f-9f6b5076b6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:13.279757 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f4443-2144-4517-8b5f-9f6b5076b6ca None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:13.280142 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f4443-2144-4517-8b5f-9f6b5076b6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:13.280480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f4443-2144-4517-8b5f-9f6b5076b6ca None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:13.281088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f4443-2144-4517-8b5f-9f6b5076b6ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:13.282545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f4443-2144-4517-8b5f-9f6b5076b6ca None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:13.289368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 491/994] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Oct 9 00:44:13 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:44:13.720416 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e363e9-6019-42a4-b83f-44b9e2e1d487 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:13.720779 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e363e9-6019-42a4-b83f-44b9e2e1d487 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:13.720964 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e363e9-6019-42a4-b83f-44b9e2e1d487 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:13.722484 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 504/995] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:13.727890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5135c9-f7db-4e0b-b77d-5fb8ab52ccd2 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:13.728175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5135c9-f7db-4e0b-b77d-5fb8ab52ccd2 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:13.728467 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5135c9-f7db-4e0b-b77d-5fb8ab52ccd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:13.747138 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1b5135c9-f7db-4e0b-b77d-5fb8ab52ccd2 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:13.748393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1b5135c9-f7db-4e0b-b77d-5fb8ab52ccd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:13.825934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 492/996] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:14.092580 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e363e9-6019-42a4-b83f-44b9e2e1d487 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:14.150426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:14.204462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e363e9-6019-42a4-b83f-44b9e2e1d487 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:14.238563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc038dc-6937-4d14-9909-5725ff5e5e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:14.239258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc038dc-6937-4d14-9909-5725ff5e5e7a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:14.239533 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc038dc-6937-4d14-9909-5725ff5e5e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:14.239800 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc038dc-6937-4d14-9909-5725ff5e5e7a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:14.240398 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc038dc-6937-4d14-9909-5725ff5e5e7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:14.241733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc038dc-6937-4d14-9909-5725ff5e5e7a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-afc038dc-6937-4d14-9909-5725ff5e5e7a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:14.250733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:14.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:14.252976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 505/997] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:44:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:14.258149 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5135c9-f7db-4e0b-b77d-5fb8ab52ccd2 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:14.316910 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:14.360366 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5135c9-f7db-4e0b-b77d-5fb8ab52ccd2 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:14.396031 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473353b-1127-49ce-95e9-f8647302c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:14.396659 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473353b-1127-49ce-95e9-f8647302c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:14.396933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473353b-1127-49ce-95e9-f8647302c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:14.397254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473353b-1127-49ce-95e9-f8647302c6c7 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:14.397879 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473353b-1127-49ce-95e9-f8647302c6c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:14.398191 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473353b-1127-49ce-95e9-f8647302c6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:14.399553 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473353b-1127-49ce-95e9-f8647302c6c7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:14.404602 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 493/998] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:44:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:14.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc038dc-6937-4d14-9909-5725ff5e5e7a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:14.514428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc038dc-6937-4d14-9909-5725ff5e5e7a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:14.532083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:14.551873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108abd1e-5394-4cf7-8dbd-57f813a33119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:14.552531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108abd1e-5394-4cf7-8dbd-57f813a33119 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:14.552803 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108abd1e-5394-4cf7-8dbd-57f813a33119 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:14.553068 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108abd1e-5394-4cf7-8dbd-57f813a33119 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:14.553689 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108abd1e-5394-4cf7-8dbd-57f813a33119 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:14.553984 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108abd1e-5394-4cf7-8dbd-57f813a33119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:14.555343 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108abd1e-5394-4cf7-8dbd-57f813a33119 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:14.560549 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 506/999] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:44:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:14.566277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473353b-1127-49ce-95e9-f8647302c6c7 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:14.669365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473353b-1127-49ce-95e9-f8647302c6c7 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:14.692122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:14.704869 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704849d-9c4f-48af-8e89-29689605b0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:14.705479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704849d-9c4f-48af-8e89-29689605b0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:14.705756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704849d-9c4f-48af-8e89-29689605b0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:14.706024 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704849d-9c4f-48af-8e89-29689605b0c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:14.706717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704849d-9c4f-48af-8e89-29689605b0c4 None admin] RBAC: Adding query filter params (interface=public, service_id=47c1894e819a40ec863ebff7257c52d2, region_id=RegionOne) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:14.707020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704849d-9c4f-48af-8e89-29689605b0c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:14.708820 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704849d-9c4f-48af-8e89-29689605b0c4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:14.714262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 494/1000] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Oct 9 00:44:14 2022] GET /identity/v3/endpoints?service_id=47c1894e819a40ec863ebff7257c52d2&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:14.719854 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108abd1e-5394-4cf7-8dbd-57f813a33119 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:14.827343 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108abd1e-5394-4cf7-8dbd-57f813a33119 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:14.863010 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453941cf-7050-45a5-8e05-39d9ba1c7787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:14.863665 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453941cf-7050-45a5-8e05-39d9ba1c7787 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:14.863953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453941cf-7050-45a5-8e05-39d9ba1c7787 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:14.864265 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453941cf-7050-45a5-8e05-39d9ba1c7787 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:14.864867 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453941cf-7050-45a5-8e05-39d9ba1c7787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:14.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453941cf-7050-45a5-8e05-39d9ba1c7787 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:14.873066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 507/1001] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Oct 9 00:44:14 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:44:15.238135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4cf21-e357-453e-a59a-5ab7ac32d431 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:15.238542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4cf21-e357-453e-a59a-5ab7ac32d431 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:15.238727 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4cf21-e357-453e-a59a-5ab7ac32d431 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:15.240034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 495/1002] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:15.245677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2939e1-df97-4ae9-a601-db2d9c8f36c9 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:15.246156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2939e1-df97-4ae9-a601-db2d9c8f36c9 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:15.246156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2939e1-df97-4ae9-a601-db2d9c8f36c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:15.265647 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-df2939e1-df97-4ae9-a601-db2d9c8f36c9 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:15.266820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-df2939e1-df97-4ae9-a601-db2d9c8f36c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:15.309024 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:15.341753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 508/1003] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:15.438216 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba0f4-1cee-469c-8a5a-222d05072d91 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:15.438755 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba0f4-1cee-469c-8a5a-222d05072d91 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:15.438755 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba0f4-1cee-469c-8a5a-222d05072d91 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:15.440329 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 496/1004] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:15.445785 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ab662-4297-4616-9904-4c5e7973f05d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:15.446065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ab662-4297-4616-9904-4c5e7973f05d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:15.446336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ab662-4297-4616-9904-4c5e7973f05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:15.464533 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-343ab662-4297-4616-9904-4c5e7973f05d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:15.465687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-343ab662-4297-4616-9904-4c5e7973f05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:15.531362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 509/1005] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:15.608381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba0f4-1cee-469c-8a5a-222d05072d91 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:15.711925 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba0f4-1cee-469c-8a5a-222d05072d91 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:15.746148 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611577b-94b1-4bee-b7b0-d895d2593fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:15.746820 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611577b-94b1-4bee-b7b0-d895d2593fba None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:15.747098 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611577b-94b1-4bee-b7b0-d895d2593fba None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:15.747366 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611577b-94b1-4bee-b7b0-d895d2593fba None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:15.748030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611577b-94b1-4bee-b7b0-d895d2593fba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:15.749487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611577b-94b1-4bee-b7b0-d895d2593fba None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:15.773801 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 497/1006] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:44:15 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:15.791108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ab662-4297-4616-9904-4c5e7973f05d None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:15.905898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ab662-4297-4616-9904-4c5e7973f05d None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:15.908531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:15.951914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e180ef-b2a2-4f9b-83f6-f3707edbf054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:15.952597 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e180ef-b2a2-4f9b-83f6-f3707edbf054 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:15.952857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e180ef-b2a2-4f9b-83f6-f3707edbf054 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:15.953167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e180ef-b2a2-4f9b-83f6-f3707edbf054 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:15.953735 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e180ef-b2a2-4f9b-83f6-f3707edbf054 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:15.955181 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e180ef-b2a2-4f9b-83f6-f3707edbf054 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-63e180ef-b2a2-4f9b-83f6-f3707edbf054 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:15.964490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:15.965518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:15.966451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 510/1007] 10.222.0.43 () {56 vars in 1126 bytes} [Sun Oct 9 00:44:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:15.971758 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611577b-94b1-4bee-b7b0-d895d2593fba None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:16.020618 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:16.079725 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611577b-94b1-4bee-b7b0-d895d2593fba None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:16.114168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562df421-8d44-42e2-bb3a-0fc36ee09917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:16.114773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562df421-8d44-42e2-bb3a-0fc36ee09917 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:16.115102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562df421-8d44-42e2-bb3a-0fc36ee09917 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:16.115374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562df421-8d44-42e2-bb3a-0fc36ee09917 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:16.115997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562df421-8d44-42e2-bb3a-0fc36ee09917 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:16.116323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562df421-8d44-42e2-bb3a-0fc36ee09917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:16.117748 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562df421-8d44-42e2-bb3a-0fc36ee09917 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:16.123007 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 498/1008] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Oct 9 00:44:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:16.128905 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e180ef-b2a2-4f9b-83f6-f3707edbf054 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:16.235604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e180ef-b2a2-4f9b-83f6-f3707edbf054 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:16.274096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba23e3-514b-404f-b90e-780b1557d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:16.274750 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba23e3-514b-404f-b90e-780b1557d497 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:16.274998 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba23e3-514b-404f-b90e-780b1557d497 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:16.275240 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba23e3-514b-404f-b90e-780b1557d497 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:16.275862 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba23e3-514b-404f-b90e-780b1557d497 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:16.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba23e3-514b-404f-b90e-780b1557d497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:16.277565 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba23e3-514b-404f-b90e-780b1557d497 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:16.282756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 511/1009] 10.222.0.43 () {56 vars in 1122 bytes} [Sun Oct 9 00:44:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:16.288723 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562df421-8d44-42e2-bb3a-0fc36ee09917 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:16.394217 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562df421-8d44-42e2-bb3a-0fc36ee09917 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:16.404879 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:16.429408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d1310-913a-4cca-8e85-3719bdc92424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:16.430025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d1310-913a-4cca-8e85-3719bdc92424 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:16.430270 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d1310-913a-4cca-8e85-3719bdc92424 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:16.430547 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d1310-913a-4cca-8e85-3719bdc92424 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:16.431219 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d1310-913a-4cca-8e85-3719bdc92424 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:16.432619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d1310-913a-4cca-8e85-3719bdc92424 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:16.450115 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 499/1010] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:44:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:17.033927 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb2c4-a59f-41cc-99d1-5bedba1cdeb8 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:17.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb2c4-a59f-41cc-99d1-5bedba1cdeb8 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:17.034472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb2c4-a59f-41cc-99d1-5bedba1cdeb8 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:17.035920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 512/1011] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:17.041586 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c012-0cab-486a-80b8-44cf947a753d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:17.041871 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c012-0cab-486a-80b8-44cf947a753d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:17.042207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c012-0cab-486a-80b8-44cf947a753d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:17.060504 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-fff4c012-0cab-486a-80b8-44cf947a753d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:17.061695 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-fff4c012-0cab-486a-80b8-44cf947a753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:17.134707 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 500/1012] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:17 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:17.399796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cb2c4-a59f-41cc-99d1-5bedba1cdeb8 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:17.429098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:17.504603 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cb2c4-a59f-41cc-99d1-5bedba1cdeb8 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:17.539068 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccc3d-dc5c-45ad-8fff-1d8791b59e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:17.539695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccc3d-dc5c-45ad-8fff-1d8791b59e79 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:17.539970 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccc3d-dc5c-45ad-8fff-1d8791b59e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:17.540276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccc3d-dc5c-45ad-8fff-1d8791b59e79 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:17.540848 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dccc3d-dc5c-45ad-8fff-1d8791b59e79 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:17.542324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dccc3d-dc5c-45ad-8fff-1d8791b59e79 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-60dccc3d-dc5c-45ad-8fff-1d8791b59e79 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:17.552029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:17.553082 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:44:17.553989 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:17.556201 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 513/1013] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:44:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:17.559402 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4c012-0cab-486a-80b8-44cf947a753d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:17.656316 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:17.663531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4c012-0cab-486a-80b8-44cf947a753d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:17.698334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4691b74-67b6-4406-a29d-d9fd2e76ee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:17.698940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4691b74-67b6-4406-a29d-d9fd2e76ee65 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:17.699210 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4691b74-67b6-4406-a29d-d9fd2e76ee65 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:17.699475 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4691b74-67b6-4406-a29d-d9fd2e76ee65 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:17.700115 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4691b74-67b6-4406-a29d-d9fd2e76ee65 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:17.700414 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4691b74-67b6-4406-a29d-d9fd2e76ee65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:17.701783 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4691b74-67b6-4406-a29d-d9fd2e76ee65 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:17.706817 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 501/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:44:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:17.712718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccc3d-dc5c-45ad-8fff-1d8791b59e79 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:17.812523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:17.822179 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccc3d-dc5c-45ad-8fff-1d8791b59e79 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:17.858383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775a4ca-32e3-4a8a-8ff1-4b3bea55ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:17.858992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775a4ca-32e3-4a8a-8ff1-4b3bea55ec04 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:17.859263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775a4ca-32e3-4a8a-8ff1-4b3bea55ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:17.859597 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775a4ca-32e3-4a8a-8ff1-4b3bea55ec04 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:17.860253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775a4ca-32e3-4a8a-8ff1-4b3bea55ec04 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:17.860551 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775a4ca-32e3-4a8a-8ff1-4b3bea55ec04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:17.861933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775a4ca-32e3-4a8a-8ff1-4b3bea55ec04 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:17.867734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 514/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Sun Oct 9 00:44:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:17.873338 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4691b74-67b6-4406-a29d-d9fd2e76ee65 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:17.961578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd320a-73ed-4c4e-a840-c0433839b08d None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:17.961765 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd320a-73ed-4c4e-a840-c0433839b08d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:17.962029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd320a-73ed-4c4e-a840-c0433839b08d None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:17.963386 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 515/1016] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:17.968420 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d62a9-6d3c-43e0-9554-7769e92caad0 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:17.968735 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d62a9-6d3c-43e0-9554-7769e92caad0 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:17.969001 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d62a9-6d3c-43e0-9554-7769e92caad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:17.974360 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4691b74-67b6-4406-a29d-d9fd2e76ee65 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:17.988267 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-724d62a9-6d3c-43e0-9554-7769e92caad0 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:17.989455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-724d62a9-6d3c-43e0-9554-7769e92caad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:18.012529 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a62f47-fd38-4e8d-8d15-fa5e5f43aecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:18.013213 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a62f47-fd38-4e8d-8d15-fa5e5f43aecc None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:18.013493 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a62f47-fd38-4e8d-8d15-fa5e5f43aecc None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:18.013761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a62f47-fd38-4e8d-8d15-fa5e5f43aecc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:18.014553 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a62f47-fd38-4e8d-8d15-fa5e5f43aecc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:18.015956 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a62f47-fd38-4e8d-8d15-fa5e5f43aecc None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:18.037674 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 502/1017] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:44:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:18.072539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 516/1018] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:18.341238 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a62f47-fd38-4e8d-8d15-fa5e5f43aecc None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:18.360970 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:18.450301 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a62f47-fd38-4e8d-8d15-fa5e5f43aecc None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:18.484979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd5cb1-71f9-4b19-883f-2dd76cf9041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:18.485613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5cb1-71f9-4b19-883f-2dd76cf9041f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:18.485885 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5cb1-71f9-4b19-883f-2dd76cf9041f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:18.486152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5cb1-71f9-4b19-883f-2dd76cf9041f None admin] PATH_INFO: `/v3/services/image` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:18.486722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd5cb1-71f9-4b19-883f-2dd76cf9041f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:18.488101 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd5cb1-71f9-4b19-883f-2dd76cf9041f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-8dcd5cb1-71f9-4b19-883f-2dd76cf9041f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:18.497231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:18.498320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:18.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 503/1019] 10.222.0.43 () {56 vars in 1105 bytes} [Sun Oct 9 00:44:18 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:18.505665 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d62a9-6d3c-43e0-9554-7769e92caad0 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:18.592756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:18.613408 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d62a9-6d3c-43e0-9554-7769e92caad0 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:18.627361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c9172-4dee-4c9c-bf3f-c51535b239d3 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:18.627905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c9172-4dee-4c9c-bf3f-c51535b239d3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:18.627905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c9172-4dee-4c9c-bf3f-c51535b239d3 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:18.629589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 504/1020] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:44:18.634771 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84c614-22c2-4667-948b-884db3ff9638 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:18.635059 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84c614-22c2-4667-948b-884db3ff9638 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:18.635327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84c614-22c2-4667-948b-884db3ff9638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:18.652902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b7915-4eb9-408e-941b-b115d681f21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:18.653525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b7915-4eb9-408e-941b-b115d681f21f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:18.653816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b7915-4eb9-408e-941b-b115d681f21f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:18.654055 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b7915-4eb9-408e-941b-b115d681f21f None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:18.654677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b7915-4eb9-408e-941b-b115d681f21f None admin] RBAC: Adding query filter params (name=image) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:18.654934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-bc84c614-22c2-4667-948b-884db3ff9638 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:18.655035 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b7915-4eb9-408e-941b-b115d681f21f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:18.656172 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bc84c614-22c2-4667-948b-884db3ff9638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:18.656411 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b7915-4eb9-408e-941b-b115d681f21f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:18.664086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 517/1021] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:18.668347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b7915-4eb9-408e-941b-b115d681f21f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:18.727428 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 505/1022] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:44:18.775879 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b7915-4eb9-408e-941b-b115d681f21f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:18.816276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b98cac-f124-4538-a6c9-f5f7d27aca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:18.816890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b98cac-f124-4538-a6c9-f5f7d27aca87 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:18.817152 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b98cac-f124-4538-a6c9-f5f7d27aca87 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:18.817420 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b98cac-f124-4538-a6c9-f5f7d27aca87 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:18.818032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b98cac-f124-4538-a6c9-f5f7d27aca87 None admin] RBAC: Adding query filter params (type=image) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:18.818323 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b98cac-f124-4538-a6c9-f5f7d27aca87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:18.819679 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b98cac-f124-4538-a6c9-f5f7d27aca87 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:18.824909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 518/1023] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:18.830739 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84c614-22c2-4667-948b-884db3ff9638 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:18.844036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:18.933464 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84c614-22c2-4667-948b-884db3ff9638 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:18.967503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897b35a-461a-4a2d-a6ed-5ae21ba0c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:18.968109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897b35a-461a-4a2d-a6ed-5ae21ba0c927 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:18.968376 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897b35a-461a-4a2d-a6ed-5ae21ba0c927 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:18.968654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897b35a-461a-4a2d-a6ed-5ae21ba0c927 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:18.969331 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897b35a-461a-4a2d-a6ed-5ae21ba0c927 None admin] RBAC: Adding query filter params (interface=public, service_id=2d400bc4aaa941cdb9b312ecedd95b8e, region_id=RegionOne) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:18.969626 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897b35a-461a-4a2d-a6ed-5ae21ba0c927 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:18.970993 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897b35a-461a-4a2d-a6ed-5ae21ba0c927 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:18.976340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 506/1024] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Oct 9 00:44:18 2022] GET /identity/v3/endpoints?service_id=2d400bc4aaa941cdb9b312ecedd95b8e&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:18.981854 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b98cac-f124-4538-a6c9-f5f7d27aca87 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:18.995248 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:19.003423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897b35a-461a-4a2d-a6ed-5ae21ba0c927 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:19.088827 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:19.095964 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b98cac-f124-4538-a6c9-f5f7d27aca87 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:19.115172 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897b35a-461a-4a2d-a6ed-5ae21ba0c927 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:19.133040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4546792-8836-471c-af2a-30ee8ad6a34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:19.133648 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546792-8836-471c-af2a-30ee8ad6a34f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:19.133923 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546792-8836-471c-af2a-30ee8ad6a34f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:19.134192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546792-8836-471c-af2a-30ee8ad6a34f None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:19.134784 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4546792-8836-471c-af2a-30ee8ad6a34f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:19.136293 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4546792-8836-471c-af2a-30ee8ad6a34f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:19.143690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 519/1025] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Oct 9 00:44:18 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:44:19.158577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b6411-fc64-436f-9347-4c68546ac48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:19.159681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6411-fc64-436f-9347-4c68546ac48d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:19.160230 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6411-fc64-436f-9347-4c68546ac48d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:19.160896 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6411-fc64-436f-9347-4c68546ac48d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:19.162571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b6411-fc64-436f-9347-4c68546ac48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:19.164479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b6411-fc64-436f-9347-4c68546ac48d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:19.166861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 507/1026] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:19.172634 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4546792-8836-471c-af2a-30ee8ad6a34f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:19.256621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:19.286338 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4546792-8836-471c-af2a-30ee8ad6a34f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:19.326176 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37897db-1840-40a6-874e-8e0c635e9cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:19.326775 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37897db-1840-40a6-874e-8e0c635e9cb7 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:19.327044 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37897db-1840-40a6-874e-8e0c635e9cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:19.327300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37897db-1840-40a6-874e-8e0c635e9cb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:19.327962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37897db-1840-40a6-874e-8e0c635e9cb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:19.329399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37897db-1840-40a6-874e-8e0c635e9cb7 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:19.358346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 520/1027] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:44:19 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:20.263019 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1f44d-7dba-48e7-a602-a60bfe04e6e0 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:20.263570 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1f44d-7dba-48e7-a602-a60bfe04e6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:20.263570 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1f44d-7dba-48e7-a602-a60bfe04e6e0 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:20.265161 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 508/1028] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:20.271210 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275c752-b67b-4745-bcd1-895b6ee88442 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:20.271797 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275c752-b67b-4745-bcd1-895b6ee88442 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:20.271797 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275c752-b67b-4745-bcd1-895b6ee88442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:20.290533 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-e275c752-b67b-4745-bcd1-895b6ee88442 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:20.291692 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e275c752-b67b-4745-bcd1-895b6ee88442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:20.359781 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 521/1029] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:20.619293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1f44d-7dba-48e7-a602-a60bfe04e6e0 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:20.729211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1f44d-7dba-48e7-a602-a60bfe04e6e0 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:20.764316 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e14132-2ff7-4cdf-9207-3a09adc5a8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:20.764945 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e14132-2ff7-4cdf-9207-3a09adc5a8cd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:20.765263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e14132-2ff7-4cdf-9207-3a09adc5a8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:20.765534 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e14132-2ff7-4cdf-9207-3a09adc5a8cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:20.780018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e14132-2ff7-4cdf-9207-3a09adc5a8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-70e14132-2ff7-4cdf-9207-3a09adc5a8cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:20.784815 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:20.785880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:44:20.786807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:20.791983 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 509/1030] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Oct 9 00:44:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:20.793049 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275c752-b67b-4745-bcd1-895b6ee88442 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:20.849040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:20.894915 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275c752-b67b-4745-bcd1-895b6ee88442 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:20.928318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e82ed1-992f-4af8-83ac-549f06c70300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:20.928923 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e82ed1-992f-4af8-83ac-549f06c70300 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:20.929189 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e82ed1-992f-4af8-83ac-549f06c70300 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:20.929450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e82ed1-992f-4af8-83ac-549f06c70300 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:20.930097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e82ed1-992f-4af8-83ac-549f06c70300 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:20.930525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e82ed1-992f-4af8-83ac-549f06c70300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:20.931884 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e82ed1-992f-4af8-83ac-549f06c70300 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:20.940384 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 522/1031] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Oct 9 00:44:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:20.946293 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e14132-2ff7-4cdf-9207-3a09adc5a8cd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:20.949785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:21.048298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e14132-2ff7-4cdf-9207-3a09adc5a8cd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:21.084090 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfdb0d-b89b-473f-b97c-41871f278acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:21.084728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfdb0d-b89b-473f-b97c-41871f278acb None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.084997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfdb0d-b89b-473f-b97c-41871f278acb None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.085266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfdb0d-b89b-473f-b97c-41871f278acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.095450 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfdb0d-b89b-473f-b97c-41871f278acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:21.096923 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfdb0d-b89b-473f-b97c-41871f278acb None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-70dfdb0d-b89b-473f-b97c-41871f278acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:21.111387 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:21.112636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:44:21.113680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:21.113680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:21.113680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:21.116379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 510/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:21.118261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e82ed1-992f-4af8-83ac-549f06c70300 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:21.220821 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e82ed1-992f-4af8-83ac-549f06c70300 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:21.239578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:21.258331 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b164ae-a9ff-4210-a434-d3848f89481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:21.258946 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b164ae-a9ff-4210-a434-d3848f89481b None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.259213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b164ae-a9ff-4210-a434-d3848f89481b None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.259474 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b164ae-a9ff-4210-a434-d3848f89481b None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.260117 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b164ae-a9ff-4210-a434-d3848f89481b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:21.260414 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b164ae-a9ff-4210-a434-d3848f89481b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:21.261759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b164ae-a9ff-4210-a434-d3848f89481b None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:21.274219 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 523/1033] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:21.279771 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfdb0d-b89b-473f-b97c-41871f278acb None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:21.335300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f908a4-1ea2-43cb-b6a2-ab5430f081d9 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.335575 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f908a4-1ea2-43cb-b6a2-ab5430f081d9 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.335842 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f908a4-1ea2-43cb-b6a2-ab5430f081d9 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.337240 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 524/1034] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:21.339259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:21.342725 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b821f6c-824a-4e87-a381-d8df76f4e254 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.343004 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b821f6c-824a-4e87-a381-d8df76f4e254 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.343404 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b821f6c-824a-4e87-a381-d8df76f4e254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.362130 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-4b821f6c-824a-4e87-a381-d8df76f4e254 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:21.363322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-4b821f6c-824a-4e87-a381-d8df76f4e254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:21.389747 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfdb0d-b89b-473f-b97c-41871f278acb None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:21.426086 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993081a-f763-41c9-bc44-adbc70fb3c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:21.426718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993081a-f763-41c9-bc44-adbc70fb3c2c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.427001 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993081a-f763-41c9-bc44-adbc70fb3c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.427263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993081a-f763-41c9-bc44-adbc70fb3c2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.435731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993081a-f763-41c9-bc44-adbc70fb3c2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:21.437246 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993081a-f763-41c9-bc44-adbc70fb3c2c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:21.442743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 525/1035] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7993081a-f763-41c9-bc44-adbc70fb3c2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:44:21.451354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:21.452490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:21.453496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:21.453496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:21.453496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:44:21.453496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:44:21.453496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:44:21.453496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:44:21.453496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:44:21.453496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:44:21.453496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:44:21.453496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:21.457570 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 511/1036] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Oct 9 00:44:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:21.461174 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b821f6c-824a-4e87-a381-d8df76f4e254 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:21.541136 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fe5d9-504f-41fe-aa4f-1871a68b228c None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.541324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fe5d9-504f-41fe-aa4f-1871a68b228c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.541576 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fe5d9-504f-41fe-aa4f-1871a68b228c None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.543132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 512/1037] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:44:21.547833 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df301-2a1e-42b0-8c15-d1a6741093fe None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.548147 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df301-2a1e-42b0-8c15-d1a6741093fe None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.548446 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df301-2a1e-42b0-8c15-d1a6741093fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.567119 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b821f6c-824a-4e87-a381-d8df76f4e254 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:21.568237 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-da5df301-2a1e-42b0-8c15-d1a6741093fe None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:21.569405 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-da5df301-2a1e-42b0-8c15-d1a6741093fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:21.579476 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:21.607362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d999c8-f709-4590-84b3-1c9c330ad277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:21.608025 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d999c8-f709-4590-84b3-1c9c330ad277 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.608328 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d999c8-f709-4590-84b3-1c9c330ad277 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.608593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d999c8-f709-4590-84b3-1c9c330ad277 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.609476 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d999c8-f709-4590-84b3-1c9c330ad277 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:21.610154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d999c8-f709-4590-84b3-1c9c330ad277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:21.611956 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d999c8-f709-4590-84b3-1c9c330ad277 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:21.631815 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 526/1038] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Oct 9 00:44:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:21.637573 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d999c8-f709-4590-84b3-1c9c330ad277 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:21.638676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 513/1039] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:21.705583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5df301-2a1e-42b0-8c15-d1a6741093fe None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:21.736270 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d999c8-f709-4590-84b3-1c9c330ad277 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:21.774078 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3c5fd-ec0a-4938-9aed-49d9cd827324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:21.774683 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c5fd-ec0a-4938-9aed-49d9cd827324 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.774949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c5fd-ec0a-4938-9aed-49d9cd827324 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.775209 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c5fd-ec0a-4938-9aed-49d9cd827324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.776973 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:21.816912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:21.831480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5df301-2a1e-42b0-8c15-d1a6741093fe None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:21.856312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3c5fd-ec0a-4938-9aed-49d9cd827324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:21.858015 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3c5fd-ec0a-4938-9aed-49d9cd827324 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:21.865218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618875f-5232-422b-97d5-5a412b88490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:21.865845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618875f-5232-422b-97d5-5a412b88490f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.866118 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618875f-5232-422b-97d5-5a412b88490f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.866385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618875f-5232-422b-97d5-5a412b88490f None admin] PATH_INFO: `/v3/services/image` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.866956 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618875f-5232-422b-97d5-5a412b88490f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:21.868338 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618875f-5232-422b-97d5-5a412b88490f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-e618875f-5232-422b-97d5-5a412b88490f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:21.876985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:21.878008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:21.879517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 514/1040] 10.222.0.43 () {56 vars in 1105 bytes} [Sun Oct 9 00:44:21 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:21.884377 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618875f-5232-422b-97d5-5a412b88490f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:21.961126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 527/1041] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:21 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 09 00:44:21.961957 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3c5fd-ec0a-4938-9aed-49d9cd827324 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:21.988201 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618875f-5232-422b-97d5-5a412b88490f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:21.997023 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:22.021735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1636e70-c44a-4b91-ae17-57e8bbd2c5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:22.022350 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1636e70-c44a-4b91-ae17-57e8bbd2c5cf None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:22.022601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1636e70-c44a-4b91-ae17-57e8bbd2c5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:22.022860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1636e70-c44a-4b91-ae17-57e8bbd2c5cf None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:22.023470 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1636e70-c44a-4b91-ae17-57e8bbd2c5cf None admin] RBAC: Adding query filter params (name=image) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:22.023761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1636e70-c44a-4b91-ae17-57e8bbd2c5cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:22.025158 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1636e70-c44a-4b91-ae17-57e8bbd2c5cf None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:22.025682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:22.030089 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 515/1042] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:22.032919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1636e70-c44a-4b91-ae17-57e8bbd2c5cf None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:22.061715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3c5fd-ec0a-4938-9aed-49d9cd827324 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:22.095764 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dcba8-7aba-4a5e-934b-85a1e5717dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:22.096421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dcba8-7aba-4a5e-934b-85a1e5717dba None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:22.096693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dcba8-7aba-4a5e-934b-85a1e5717dba None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:22.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dcba8-7aba-4a5e-934b-85a1e5717dba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:22.098062 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dcba8-7aba-4a5e-934b-85a1e5717dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:22.099474 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dcba8-7aba-4a5e-934b-85a1e5717dba None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:22.101075 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 528/1043] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:22.101844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dcba8-7aba-4a5e-934b-85a1e5717dba None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:22.131921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1636e70-c44a-4b91-ae17-57e8bbd2c5cf None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:22.166823 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72819-0bb5-47bc-a584-58c5491fc017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:22.167431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72819-0bb5-47bc-a584-58c5491fc017 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:22.167693 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72819-0bb5-47bc-a584-58c5491fc017 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:22.167957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72819-0bb5-47bc-a584-58c5491fc017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:22.178792 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac72819-0bb5-47bc-a584-58c5491fc017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:22.180292 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac72819-0bb5-47bc-a584-58c5491fc017 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0ac72819-0bb5-47bc-a584-58c5491fc017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:22.195045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:22.196873 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:44:22.198092 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:22.198092 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:22.198092 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:22.198092 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 516/1044] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:22.198092 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72819-0bb5-47bc-a584-58c5491fc017 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:22.204685 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dcba8-7aba-4a5e-934b-85a1e5717dba None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:22.223816 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:22.238401 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1281e-b8d7-45bc-99d4-1fa754660ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:22.239020 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1281e-b8d7-45bc-99d4-1fa754660ffa None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:22.239291 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1281e-b8d7-45bc-99d4-1fa754660ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:22.239575 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1281e-b8d7-45bc-99d4-1fa754660ffa None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:22.240233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1281e-b8d7-45bc-99d4-1fa754660ffa None admin] RBAC: Adding query filter params (type=image) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:22.240528 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1281e-b8d7-45bc-99d4-1fa754660ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:22.241886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1281e-b8d7-45bc-99d4-1fa754660ffa None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:22.243084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:22.247606 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 529/1045] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:22.248412 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1281e-b8d7-45bc-99d4-1fa754660ffa None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:22.299938 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72819-0bb5-47bc-a584-58c5491fc017 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:22.335381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf7d87-3428-4397-b014-e9192b6cde59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:22.335945 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf7d87-3428-4397-b014-e9192b6cde59 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:22.336323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf7d87-3428-4397-b014-e9192b6cde59 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:22.336597 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf7d87-3428-4397-b014-e9192b6cde59 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:22.337251 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf7d87-3428-4397-b014-e9192b6cde59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:22.338685 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf7d87-3428-4397-b014-e9192b6cde59 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:22.348826 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1281e-b8d7-45bc-99d4-1fa754660ffa None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:22.360841 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 517/1046] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:44:22 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:22.361638 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf7d87-3428-4397-b014-e9192b6cde59 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:22.392403 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15df0b-50b6-4776-847b-5d158479fbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:22.393130 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15df0b-50b6-4776-847b-5d158479fbdb None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:22.393472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15df0b-50b6-4776-847b-5d158479fbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:22.393850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15df0b-50b6-4776-847b-5d158479fbdb None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:22.394565 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15df0b-50b6-4776-847b-5d158479fbdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:22.395121 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15df0b-50b6-4776-847b-5d158479fbdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:22.396677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15df0b-50b6-4776-847b-5d158479fbdb None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:22.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 530/1047] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:22.415125 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15df0b-50b6-4776-847b-5d158479fbdb None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:22.453188 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:22.479842 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf7d87-3428-4397-b014-e9192b6cde59 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:22.483932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:22.520377 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b94c40-499b-49ae-a1b6-f2506c86198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:22.521182 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94c40-499b-49ae-a1b6-f2506c86198d None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:22.521456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94c40-499b-49ae-a1b6-f2506c86198d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:22.521744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94c40-499b-49ae-a1b6-f2506c86198d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:22.522487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b94c40-499b-49ae-a1b6-f2506c86198d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:22.523883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b94c40-499b-49ae-a1b6-f2506c86198d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:22.527683 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15df0b-50b6-4776-847b-5d158479fbdb None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:22.547694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 518/1048] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:44:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:22.575308 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011e48f-7542-4459-9b8d-d76a141b570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:22.575961 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e48f-7542-4459-9b8d-d76a141b570e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:22.576295 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e48f-7542-4459-9b8d-d76a141b570e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:22.576525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e48f-7542-4459-9b8d-d76a141b570e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:22.584500 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011e48f-7542-4459-9b8d-d76a141b570e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:22.586019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011e48f-7542-4459-9b8d-d76a141b570e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-e011e48f-7542-4459-9b8d-d76a141b570e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:44:22.599437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:22.600653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:22.601778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:44:22.601778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:44:22.601778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:44:22.601778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:44:22.601778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:44:22.601778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:44:22.601778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:22.601778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:22.601778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 531/1049] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:44:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:44:22.608634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b94c40-499b-49ae-a1b6-f2506c86198d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:22.732194 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b94c40-499b-49ae-a1b6-f2506c86198d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:22.770204 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfb4c0-bb12-4893-854c-9edf4ca1bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:22.771072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb4c0-bb12-4893-854c-9edf4ca1bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:22.771524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb4c0-bb12-4893-854c-9edf4ca1bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:22.771936 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb4c0-bb12-4893-854c-9edf4ca1bdf7 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:22.772797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfb4c0-bb12-4893-854c-9edf4ca1bdf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:22.773098 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfb4c0-bb12-4893-854c-9edf4ca1bdf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:22.774533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfb4c0-bb12-4893-854c-9edf4ca1bdf7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:22.778079 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:22.790324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 519/1050] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:22.795705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011e48f-7542-4459-9b8d-d76a141b570e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:22.897681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011e48f-7542-4459-9b8d-d76a141b570e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:22.911332 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:22.932664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e153633-f477-4d27-bc22-2eebd1d80f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:22.933408 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e153633-f477-4d27-bc22-2eebd1d80f84 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:22.933738 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e153633-f477-4d27-bc22-2eebd1d80f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:22.934099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e153633-f477-4d27-bc22-2eebd1d80f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:22.934868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e153633-f477-4d27-bc22-2eebd1d80f84 None admin] RBAC: Adding query filter params (role.id=20ab666cb7654e36a5ca610eb516a482, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=f960fdabbffa4813a0ea46bb82218f09) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:22.935229 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e153633-f477-4d27-bc22-2eebd1d80f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:22.936780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e153633-f477-4d27-bc22-2eebd1d80f84 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:22.947292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 532/1051] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:22 2022] GET /identity/v3/role_assignments?user.id=f960fdabbffa4813a0ea46bb82218f09&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=20ab666cb7654e36a5ca610eb516a482 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:24.608498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b205c-5aa8-42e4-b396-3126b1ce0728 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:24.609117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b205c-5aa8-42e4-b396-3126b1ce0728 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:24.609117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b205c-5aa8-42e4-b396-3126b1ce0728 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:24.612107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 520/1052] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:24.616733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d70ee9-3900-47cd-a6b6-39077273468c None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:24.617285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d70ee9-3900-47cd-a6b6-39077273468c None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:24.617285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d70ee9-3900-47cd-a6b6-39077273468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:24.637637 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-09d70ee9-3900-47cd-a6b6-39077273468c None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:24.638849 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-09d70ee9-3900-47cd-a6b6-39077273468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:24.709827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 533/1053] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:24.719588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90b92-c21e-4626-8f36-196584e3a92f None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:24.719879 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90b92-c21e-4626-8f36-196584e3a92f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:24.720183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90b92-c21e-4626-8f36-196584e3a92f None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:24.721631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 521/1054] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:24.726903 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195220f-22af-452e-9328-7cdb268efac1 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:24.727185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195220f-22af-452e-9328-7cdb268efac1 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:24.727452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195220f-22af-452e-9328-7cdb268efac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:24.746108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-b195220f-22af-452e-9328-7cdb268efac1 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:24.747291 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-b195220f-22af-452e-9328-7cdb268efac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:24.820436 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 534/1055] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:24.978044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b90b92-c21e-4626-8f36-196584e3a92f None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:25.059986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a1032-6de7-430d-b208-5f681cb12608 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:25.060382 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a1032-6de7-430d-b208-5f681cb12608 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:25.060618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a1032-6de7-430d-b208-5f681cb12608 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:25.062692 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 535/1056] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:25.067754 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87c7ea-44f6-48dc-aa87-a2135e7467f0 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:25.068037 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87c7ea-44f6-48dc-aa87-a2135e7467f0 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:25.068344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87c7ea-44f6-48dc-aa87-a2135e7467f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:25.088739 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b90b92-c21e-4626-8f36-196584e3a92f None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:25.089487 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-9e87c7ea-44f6-48dc-aa87-a2135e7467f0 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:25.090764 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-9e87c7ea-44f6-48dc-aa87-a2135e7467f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:25.120889 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:25.123530 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafb159-0afc-42f7-82c3-59d9d4fc3a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:25.124259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafb159-0afc-42f7-82c3-59d9d4fc3a59 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:25.124534 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafb159-0afc-42f7-82c3-59d9d4fc3a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:25.124799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafb159-0afc-42f7-82c3-59d9d4fc3a59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:25.135294 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafb159-0afc-42f7-82c3-59d9d4fc3a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-beafb159-0afc-42f7-82c3-59d9d4fc3a59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:25.140032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:25.141050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:25.141952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 522/1057] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:44:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:25.142705 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafb159-0afc-42f7-82c3-59d9d4fc3a59 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:25.165107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 536/1058] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:25.165949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87c7ea-44f6-48dc-aa87-a2135e7467f0 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:25.209350 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:25.257231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafb159-0afc-42f7-82c3-59d9d4fc3a59 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:25.271391 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87c7ea-44f6-48dc-aa87-a2135e7467f0 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:25.293467 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cdfbf-536b-43ee-82aa-3fe2bd4ed652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:25.294157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cdfbf-536b-43ee-82aa-3fe2bd4ed652 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:25.294438 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cdfbf-536b-43ee-82aa-3fe2bd4ed652 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:25.294608 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cdfbf-536b-43ee-82aa-3fe2bd4ed652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:25.308255 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd1f3b-4ac2-4d1d-bee4-2b860197c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:25.308861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd1f3b-4ac2-4d1d-bee4-2b860197c54e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:25.309231 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd1f3b-4ac2-4d1d-bee4-2b860197c54e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:25.309504 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd1f3b-4ac2-4d1d-bee4-2b860197c54e None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:25.310157 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd1f3b-4ac2-4d1d-bee4-2b860197c54e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:25.310452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd1f3b-4ac2-4d1d-bee4-2b860197c54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:25.311809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd1f3b-4ac2-4d1d-bee4-2b860197c54e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:25.320397 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 537/1059] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:25.326458 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd1f3b-4ac2-4d1d-bee4-2b860197c54e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:25.357329 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:25.370369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cdfbf-536b-43ee-82aa-3fe2bd4ed652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:25.372182 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cdfbf-536b-43ee-82aa-3fe2bd4ed652 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:25.428698 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:25.429084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd1f3b-4ac2-4d1d-bee4-2b860197c54e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:25.467927 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbe687-2488-42e8-8355-4db1226224ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:25.468623 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbe687-2488-42e8-8355-4db1226224ea None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:25.468892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbe687-2488-42e8-8355-4db1226224ea None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:25.469161 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbe687-2488-42e8-8355-4db1226224ea None admin] PATH_INFO: `/v3/users/ff4276b097774e69a80740d9f84e6237` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:25.479887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 523/1060] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:25.480767 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cdfbf-536b-43ee-82aa-3fe2bd4ed652 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:25.484604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbe687-2488-42e8-8355-4db1226224ea None admin] RBAC: Authorizing `identity:get_user(user_id=ff4276b097774e69a80740d9f84e6237)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:25.486217 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbe687-2488-42e8-8355-4db1226224ea None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:25.489011 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 538/1061] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:25 2022] GET /identity/v3/users/ff4276b097774e69a80740d9f84e6237 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:25.489011 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbe687-2488-42e8-8355-4db1226224ea None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:25.574436 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:25.580748 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cdfbf-536b-43ee-82aa-3fe2bd4ed652 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:25.586463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbe687-2488-42e8-8355-4db1226224ea None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:25.613808 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260e216-7763-4f41-b9e2-0f1bcd46e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:25.614435 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e216-7763-4f41-b9e2-0f1bcd46e641 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:25.614713 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e216-7763-4f41-b9e2-0f1bcd46e641 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:25.614980 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e216-7763-4f41-b9e2-0f1bcd46e641 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:25.619964 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22796b71-2a08-43cc-bb3d-c904e5763df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:25.620613 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22796b71-2a08-43cc-bb3d-c904e5763df8 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:25.620882 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22796b71-2a08-43cc-bb3d-c904e5763df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:25.621141 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22796b71-2a08-43cc-bb3d-c904e5763df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:25.624882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260e216-7763-4f41-b9e2-0f1bcd46e641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7260e216-7763-4f41-b9e2-0f1bcd46e641 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:25.629731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:25.630711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:25.631921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 524/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Oct 9 00:44:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:25.632716 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22796b71-2a08-43cc-bb3d-c904e5763df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:25.632792 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260e216-7763-4f41-b9e2-0f1bcd46e641 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:25.633512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22796b71-2a08-43cc-bb3d-c904e5763df8 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-22796b71-2a08-43cc-bb3d-c904e5763df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:25.649137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:25.650207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:44:25.651135 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:25.651135 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:25.651135 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:25.652218 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 539/1063] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:25.653213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22796b71-2a08-43cc-bb3d-c904e5763df8 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:25.653956 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:25.736687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260e216-7763-4f41-b9e2-0f1bcd46e641 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:25.753079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22796b71-2a08-43cc-bb3d-c904e5763df8 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:25.775984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3bb34-68ad-4d3f-914e-c152427cb1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:25.776625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bb34-68ad-4d3f-914e-c152427cb1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:25.776900 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bb34-68ad-4d3f-914e-c152427cb1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:25.777168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bb34-68ad-4d3f-914e-c152427cb1a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:25.788741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540047a0-ea30-4983-86cb-a2402f5c7d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:25.789347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540047a0-ea30-4983-86cb-a2402f5c7d2b None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:25.789611 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540047a0-ea30-4983-86cb-a2402f5c7d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:25.789871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540047a0-ea30-4983-86cb-a2402f5c7d2b None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:25.790516 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540047a0-ea30-4983-86cb-a2402f5c7d2b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:25.790807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540047a0-ea30-4983-86cb-a2402f5c7d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:25.792343 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540047a0-ea30-4983-86cb-a2402f5c7d2b None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:25.801263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 540/1064] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Oct 9 00:44:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:25.805053 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540047a0-ea30-4983-86cb-a2402f5c7d2b None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:25.807810 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:25.843178 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3bb34-68ad-4d3f-914e-c152427cb1a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:25.844590 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3bb34-68ad-4d3f-914e-c152427cb1a8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:25.860899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:25.904948 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540047a0-ea30-4983-86cb-a2402f5c7d2b None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:25.940004 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ec2ca-6749-46c9-bbd3-6d332863183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:25.940639 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ec2ca-6749-46c9-bbd3-6d332863183d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:25.940909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ec2ca-6749-46c9-bbd3-6d332863183d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:25.941175 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ec2ca-6749-46c9-bbd3-6d332863183d None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:25.941886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ec2ca-6749-46c9-bbd3-6d332863183d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:25.942180 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ec2ca-6749-46c9-bbd3-6d332863183d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:25.943536 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ec2ca-6749-46c9-bbd3-6d332863183d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:25.944184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 525/1065] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:25.945016 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3bb34-68ad-4d3f-914e-c152427cb1a8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:25.960097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 541/1066] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:25.960267 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ec2ca-6749-46c9-bbd3-6d332863183d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:26.029265 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:26.067809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3bb34-68ad-4d3f-914e-c152427cb1a8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:26.075474 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ec2ca-6749-46c9-bbd3-6d332863183d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:26.087497 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:26.108243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a8ef6-b069-4845-9f94-6d6d83677ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:26.108872 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a8ef6-b069-4845-9f94-6d6d83677ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:26.109075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a8ef6-b069-4845-9f94-6d6d83677ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:26.109347 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a8ef6-b069-4845-9f94-6d6d83677ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:26.116268 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e314a8a-e09f-4473-ad6f-de561b7a2cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:26.116921 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e314a8a-e09f-4473-ad6f-de561b7a2cef None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:26.117192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e314a8a-e09f-4473-ad6f-de561b7a2cef None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:26.117459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e314a8a-e09f-4473-ad6f-de561b7a2cef None admin] PATH_INFO: `/v3/projects/3cb644dd1e874438b662f654ea913b62` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:26.118625 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e314a8a-e09f-4473-ad6f-de561b7a2cef None admin] RBAC: Authorizing `identity:get_project(project_id=3cb644dd1e874438b662f654ea913b62)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:26.120092 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e314a8a-e09f-4473-ad6f-de561b7a2cef None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:26.120744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a8ef6-b069-4845-9f94-6d6d83677ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:26.127160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 542/1067] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:25 2022] GET /identity/v3/projects/3cb644dd1e874438b662f654ea913b62 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:26.127320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a8ef6-b069-4845-9f94-6d6d83677ad5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:26.129335 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e314a8a-e09f-4473-ad6f-de561b7a2cef None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-2c2a8ef6-b069-4845-9f94-6d6d83677ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:26.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:26.144399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:44:26.145521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:26.145521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:26.145521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:26.145521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 526/1068] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:26.150269 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a8ef6-b069-4845-9f94-6d6d83677ad5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:26.235418 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e314a8a-e09f-4473-ad6f-de561b7a2cef None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:26.263099 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a8ef6-b069-4845-9f94-6d6d83677ad5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:26.267612 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:26.273605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f7d8d-385b-4a40-8018-828ff1d5af7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:26.274222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7d8d-385b-4a40-8018-828ff1d5af7d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:26.274678 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7d8d-385b-4a40-8018-828ff1d5af7d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:26.275093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7d8d-385b-4a40-8018-828ff1d5af7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:26.276182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f7d8d-385b-4a40-8018-828ff1d5af7d None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=3cb644dd1e874438b662f654ea913b62, user.id=ff4276b097774e69a80740d9f84e6237) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:26.276479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f7d8d-385b-4a40-8018-828ff1d5af7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:26.277900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f7d8d-385b-4a40-8018-828ff1d5af7d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:26.285479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 543/1069] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:26 2022] GET /identity/v3/role_assignments?user.id=ff4276b097774e69a80740d9f84e6237&scope.project.id=3cb644dd1e874438b662f654ea913b62&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:26.302988 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18ce29-86ef-4d49-9079-5550a6e82618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:26.303733 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ce29-86ef-4d49-9079-5550a6e82618 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:26.304231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ce29-86ef-4d49-9079-5550a6e82618 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:26.304567 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ce29-86ef-4d49-9079-5550a6e82618 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:26.305282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18ce29-86ef-4d49-9079-5550a6e82618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:26.305645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18ce29-86ef-4d49-9079-5550a6e82618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:26.307066 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18ce29-86ef-4d49-9079-5550a6e82618 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:26.321159 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 527/1070] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:26.327156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f7d8d-385b-4a40-8018-828ff1d5af7d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:26.436558 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f7d8d-385b-4a40-8018-828ff1d5af7d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:26.472923 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6c747-c464-438c-806b-b424ad7a44c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:26.473834 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6c747-c464-438c-806b-b424ad7a44c6 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:26.474114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6c747-c464-438c-806b-b424ad7a44c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:26.474385 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6c747-c464-438c-806b-b424ad7a44c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:26.482772 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6c747-c464-438c-806b-b424ad7a44c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:26.484260 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6c747-c464-438c-806b-b424ad7a44c6 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-fab6c747-c464-438c-806b-b424ad7a44c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:44:26.495786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:26.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:26.498223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:26.498223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:26.498223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:44:26.498223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:44:26.498223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:44:26.498223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:44:26.498223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:44:26.498223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:44:26.498223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:44:26.498223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:26.500431 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 544/1071] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Oct 9 00:44:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:26.502709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18ce29-86ef-4d49-9079-5550a6e82618 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:26.531299 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:26.606989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18ce29-86ef-4d49-9079-5550a6e82618 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:26.643174 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e087f-c3ce-4cf3-8883-80f1049883d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:26.643820 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e087f-c3ce-4cf3-8883-80f1049883d4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:26.644011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e087f-c3ce-4cf3-8883-80f1049883d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:26.644337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e087f-c3ce-4cf3-8883-80f1049883d4 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:26.645382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e087f-c3ce-4cf3-8883-80f1049883d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:26.645772 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e087f-c3ce-4cf3-8883-80f1049883d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:26.647213 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e087f-c3ce-4cf3-8883-80f1049883d4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:26.665152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 528/1072] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Oct 9 00:44:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:26.671303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6c747-c464-438c-806b-b424ad7a44c6 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:26.729385 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:26.773139 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6c747-c464-438c-806b-b424ad7a44c6 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:26.808081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b6b72-dab1-4802-97a6-c3b152f6b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:26.808737 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6b72-dab1-4802-97a6-c3b152f6b102 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:26.809010 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6b72-dab1-4802-97a6-c3b152f6b102 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:26.809280 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b6b72-dab1-4802-97a6-c3b152f6b102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:26.819902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b6b72-dab1-4802-97a6-c3b152f6b102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:26.821377 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b6b72-dab1-4802-97a6-c3b152f6b102 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-210b6b72-dab1-4802-97a6-c3b152f6b102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:26.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:26.836428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:44:26.837381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:26.837381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:26.837381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:26.837381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 545/1073] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:26.842395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e087f-c3ce-4cf3-8883-80f1049883d4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:26.927594 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:26.944060 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e087f-c3ce-4cf3-8883-80f1049883d4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:26.978954 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a979f-4ffc-42bb-820a-2b3a1a8a5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:26.979620 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a979f-4ffc-42bb-820a-2b3a1a8a5dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:26.979803 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a979f-4ffc-42bb-820a-2b3a1a8a5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:26.980096 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a979f-4ffc-42bb-820a-2b3a1a8a5dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:26.980756 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a979f-4ffc-42bb-820a-2b3a1a8a5dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:26.981053 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a979f-4ffc-42bb-820a-2b3a1a8a5dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:26.982432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a979f-4ffc-42bb-820a-2b3a1a8a5dc3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:26.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 529/1074] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:26.999986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b6b72-dab1-4802-97a6-c3b152f6b102 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:27.106010 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b6b72-dab1-4802-97a6-c3b152f6b102 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:27.112975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:27.140739 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5d6f2-8ab5-4f8c-a089-18a2f636c469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:27.141380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5d6f2-8ab5-4f8c-a089-18a2f636c469 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:27.141653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5d6f2-8ab5-4f8c-a089-18a2f636c469 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:27.141922 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5d6f2-8ab5-4f8c-a089-18a2f636c469 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:27.149732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5d6f2-8ab5-4f8c-a089-18a2f636c469 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:27.151196 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5d6f2-8ab5-4f8c-a089-18a2f636c469 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-a8b5d6f2-8ab5-4f8c-a089-18a2f636c469 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:44:27.163875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:27.164916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:27.165883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:44:27.165883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:44:27.165883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:44:27.165883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:44:27.165883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:44:27.165883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:44:27.165883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:27.165883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:27.165883 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 546/1075] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:27.171042 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a979f-4ffc-42bb-820a-2b3a1a8a5dc3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:27.274185 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a979f-4ffc-42bb-820a-2b3a1a8a5dc3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:27.308542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a300-fab7-4027-a83a-c1d02ef0bf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:27.309140 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a300-fab7-4027-a83a-c1d02ef0bf40 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:27.309415 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a300-fab7-4027-a83a-c1d02ef0bf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:27.309681 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a300-fab7-4027-a83a-c1d02ef0bf40 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:27.310343 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a300-fab7-4027-a83a-c1d02ef0bf40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:27.310656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a300-fab7-4027-a83a-c1d02ef0bf40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:27.312096 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a300-fab7-4027-a83a-c1d02ef0bf40 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:27.324619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 530/1076] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:44:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:27.330855 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5d6f2-8ab5-4f8c-a089-18a2f636c469 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:27.431708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5d6f2-8ab5-4f8c-a089-18a2f636c469 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:27.467203 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37148f-5073-4675-a607-12e711a42348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:27.467858 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37148f-5073-4675-a607-12e711a42348 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:27.468159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37148f-5073-4675-a607-12e711a42348 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:27.468427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37148f-5073-4675-a607-12e711a42348 None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/f960fdabbffa4813a0ea46bb82218f09/roles/20ab666cb7654e36a5ca610eb516a482` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:27.470747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37148f-5073-4675-a607-12e711a42348 None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=f960fdabbffa4813a0ea46bb82218f09, role_id=20ab666cb7654e36a5ca610eb516a482)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:27.472190 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37148f-5073-4675-a607-12e711a42348 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:27.486794 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 547/1077] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:44:27 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/f960fdabbffa4813a0ea46bb82218f09/roles/20ab666cb7654e36a5ca610eb516a482 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:44:28.438227 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcaaf2-135d-4150-8311-2f3831d65de5 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:28.438784 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcaaf2-135d-4150-8311-2f3831d65de5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:28.438784 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcaaf2-135d-4150-8311-2f3831d65de5 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:28.440105 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 531/1078] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:28.445805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4f21c-0961-4f47-9e9c-93eee43ecace None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:28.446232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4f21c-0961-4f47-9e9c-93eee43ecace None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:28.446416 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4f21c-0961-4f47-9e9c-93eee43ecace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:28.464872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-35d4f21c-0961-4f47-9e9c-93eee43ecace None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:28.466052 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-35d4f21c-0961-4f47-9e9c-93eee43ecace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:28.486388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:28.534565 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 548/1079] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:44:28.803073 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcaaf2-135d-4150-8311-2f3831d65de5 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:28.812247 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:28.909251 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcaaf2-135d-4150-8311-2f3831d65de5 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:28.944515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b0029-2abe-4c5a-af07-0acace0abffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:28.945123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b0029-2abe-4c5a-af07-0acace0abffd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:28.945401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b0029-2abe-4c5a-af07-0acace0abffd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:28.945665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b0029-2abe-4c5a-af07-0acace0abffd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:28.957408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b0029-2abe-4c5a-af07-0acace0abffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-ac8b0029-2abe-4c5a-af07-0acace0abffd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:28.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:28.963621 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:28.965271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 532/1080] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:44:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:28.969969 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4f21c-0961-4f47-9e9c-93eee43ecace None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:29.069944 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4f21c-0961-4f47-9e9c-93eee43ecace None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:29.104408 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf2235-96e4-42a4-b020-4b237074e116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:29.105007 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf2235-96e4-42a4-b020-4b237074e116 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:29.105288 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf2235-96e4-42a4-b020-4b237074e116 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:29.105513 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf2235-96e4-42a4-b020-4b237074e116 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:29.106184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf2235-96e4-42a4-b020-4b237074e116 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:29.106476 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf2235-96e4-42a4-b020-4b237074e116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:29.107820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf2235-96e4-42a4-b020-4b237074e116 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:29.116267 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 549/1081] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:29.122216 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b0029-2abe-4c5a-af07-0acace0abffd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:29.190760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:29.226798 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b0029-2abe-4c5a-af07-0acace0abffd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:29.264652 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214947e5-3cb8-45e9-9365-759398781214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:29.265290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214947e5-3cb8-45e9-9365-759398781214 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:29.265569 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214947e5-3cb8-45e9-9365-759398781214 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:29.265838 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214947e5-3cb8-45e9-9365-759398781214 None admin] PATH_INFO: `/v3/users/ff4276b097774e69a80740d9f84e6237` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:29.266969 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214947e5-3cb8-45e9-9365-759398781214 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4276b097774e69a80740d9f84e6237)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:29.268462 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214947e5-3cb8-45e9-9365-759398781214 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:29.272104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 533/1082] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:29 2022] GET /identity/v3/users/ff4276b097774e69a80740d9f84e6237 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:29.276371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf2235-96e4-42a4-b020-4b237074e116 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:29.297196 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:29.379830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf2235-96e4-42a4-b020-4b237074e116 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:29.414983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129940b-fe5b-416f-b540-c5ce68d05aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:29.415617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129940b-fe5b-416f-b540-c5ce68d05aab None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:29.415889 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129940b-fe5b-416f-b540-c5ce68d05aab None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:29.416175 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129940b-fe5b-416f-b540-c5ce68d05aab None admin] PATH_INFO: `/v3/projects/3cb644dd1e874438b662f654ea913b62` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:29.417280 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129940b-fe5b-416f-b540-c5ce68d05aab None admin] RBAC: Authorizing `identity:get_project(project_id=3cb644dd1e874438b662f654ea913b62)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:29.418704 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129940b-fe5b-416f-b540-c5ce68d05aab None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:29.426963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 550/1083] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:29 2022] GET /identity/v3/projects/3cb644dd1e874438b662f654ea913b62 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:29.427146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214947e5-3cb8-45e9-9365-759398781214 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:29.531731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214947e5-3cb8-45e9-9365-759398781214 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:29.569428 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011f4b1-5652-4711-a52e-c65ef1e27311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:29.570107 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011f4b1-5652-4711-a52e-c65ef1e27311 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:29.570361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011f4b1-5652-4711-a52e-c65ef1e27311 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:29.570628 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011f4b1-5652-4711-a52e-c65ef1e27311 None admin] PATH_INFO: `/v3/projects/3cb644dd1e874438b662f654ea913b62/users/ff4276b097774e69a80740d9f84e6237/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:29.572510 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011f4b1-5652-4711-a52e-c65ef1e27311 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cb644dd1e874438b662f654ea913b62, user_id=ff4276b097774e69a80740d9f84e6237, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:29.573969 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011f4b1-5652-4711-a52e-c65ef1e27311 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:29.576193 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:29.587728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 534/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:44:29 2022] PUT /identity/v3/projects/3cb644dd1e874438b662f654ea913b62/users/ff4276b097774e69a80740d9f84e6237/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:44:29.600816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec6a7b-6ebf-4a2a-82e1-03e9ff0a5cf9 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:29.601397 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec6a7b-6ebf-4a2a-82e1-03e9ff0a5cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:29.601397 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec6a7b-6ebf-4a2a-82e1-03e9ff0a5cf9 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:29.602756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 551/1085] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:29.608920 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820a9c7-c85d-402b-b4c4-1aab39a38628 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:29.609196 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820a9c7-c85d-402b-b4c4-1aab39a38628 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:29.609465 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820a9c7-c85d-402b-b4c4-1aab39a38628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:29.628689 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5820a9c7-c85d-402b-b4c4-1aab39a38628 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:29.630166 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5820a9c7-c85d-402b-b4c4-1aab39a38628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:29.703658 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 535/1086] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:29.965545 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec6a7b-6ebf-4a2a-82e1-03e9ff0a5cf9 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:30.053567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:30.070189 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec6a7b-6ebf-4a2a-82e1-03e9ff0a5cf9 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:30.103956 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5dc7c-501e-45a4-9d12-6ca9fa9bcb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:30.104615 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5dc7c-501e-45a4-9d12-6ca9fa9bcb00 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:30.104884 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5dc7c-501e-45a4-9d12-6ca9fa9bcb00 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:30.105147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5dc7c-501e-45a4-9d12-6ca9fa9bcb00 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:30.116411 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5dc7c-501e-45a4-9d12-6ca9fa9bcb00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-eae5dc7c-501e-45a4-9d12-6ca9fa9bcb00 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:30.121137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:30.122379 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:44:30.123519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:30.127264 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 552/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Sun Oct 9 00:44:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:30.128351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820a9c7-c85d-402b-b4c4-1aab39a38628 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:30.230524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820a9c7-c85d-402b-b4c4-1aab39a38628 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:30.253799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:30.266556 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991700e2-6ee3-454b-bece-23f00d2707df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:30.267160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991700e2-6ee3-454b-bece-23f00d2707df None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:30.267429 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991700e2-6ee3-454b-bece-23f00d2707df None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:30.267693 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991700e2-6ee3-454b-bece-23f00d2707df None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:30.268380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991700e2-6ee3-454b-bece-23f00d2707df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:30.268682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991700e2-6ee3-454b-bece-23f00d2707df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:30.270171 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991700e2-6ee3-454b-bece-23f00d2707df None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:30.278422 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 536/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Oct 9 00:44:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:30.284364 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5dc7c-501e-45a4-9d12-6ca9fa9bcb00 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:30.387318 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5dc7c-501e-45a4-9d12-6ca9fa9bcb00 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:30.420326 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c74c68-6bd3-43e7-bf5c-09c82522a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:30.420949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c74c68-6bd3-43e7-bf5c-09c82522a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:30.421218 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c74c68-6bd3-43e7-bf5c-09c82522a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:30.421483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c74c68-6bd3-43e7-bf5c-09c82522a4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:30.432404 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c74c68-6bd3-43e7-bf5c-09c82522a4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:30.433845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c74c68-6bd3-43e7-bf5c-09c82522a4d1 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:30.440734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-61c74c68-6bd3-43e7-bf5c-09c82522a4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:30.450147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:30.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:44:30.452270 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:30.452270 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:30.452270 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:30.456229 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 553/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:30.457688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991700e2-6ee3-454b-bece-23f00d2707df None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:30.560160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991700e2-6ee3-454b-bece-23f00d2707df None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:30.592739 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031b8a-74dd-45b5-b2fe-f1d56564bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:30.593366 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031b8a-74dd-45b5-b2fe-f1d56564bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:30.593644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031b8a-74dd-45b5-b2fe-f1d56564bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:30.593911 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031b8a-74dd-45b5-b2fe-f1d56564bcb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:30.594533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031b8a-74dd-45b5-b2fe-f1d56564bcb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:30.594828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031b8a-74dd-45b5-b2fe-f1d56564bcb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:30.596218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031b8a-74dd-45b5-b2fe-f1d56564bcb3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:30.607602 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 537/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:30.613387 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c74c68-6bd3-43e7-bf5c-09c82522a4d1 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:30.713818 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c74c68-6bd3-43e7-bf5c-09c82522a4d1 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:30.747886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae78ad9-54bd-4258-8195-3ef3b6faabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:30.748523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae78ad9-54bd-4258-8195-3ef3b6faabfb None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:30.748794 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae78ad9-54bd-4258-8195-3ef3b6faabfb None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:30.749055 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae78ad9-54bd-4258-8195-3ef3b6faabfb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:30.757105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae78ad9-54bd-4258-8195-3ef3b6faabfb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:30.758525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae78ad9-54bd-4258-8195-3ef3b6faabfb None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-6ae78ad9-54bd-4258-8195-3ef3b6faabfb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:44:30.769720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:30.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:30.772215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:30.772215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:30.772215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:44:30.772215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:44:30.772215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:44:30.772215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:44:30.772215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:44:30.772215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:44:30.772215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:44:30.772215 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:44:30.775735 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 554/1091] 10.222.0.43 () {56 vars in 1093 bytes} [Sun Oct 9 00:44:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:30.776910 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031b8a-74dd-45b5-b2fe-f1d56564bcb3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:30.829351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:30.885073 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031b8a-74dd-45b5-b2fe-f1d56564bcb3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:30.919796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39883ff6-82d6-43ab-8827-0f912ee0e531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:30.920425 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39883ff6-82d6-43ab-8827-0f912ee0e531 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:30.920697 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39883ff6-82d6-43ab-8827-0f912ee0e531 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:30.920971 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39883ff6-82d6-43ab-8827-0f912ee0e531 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:30.921679 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39883ff6-82d6-43ab-8827-0f912ee0e531 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:30.921974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39883ff6-82d6-43ab-8827-0f912ee0e531 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:30.923411 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39883ff6-82d6-43ab-8827-0f912ee0e531 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:30.941577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 538/1092] 10.222.0.43 () {56 vars in 1133 bytes} [Sun Oct 9 00:44:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:30.947596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae78ad9-54bd-4258-8195-3ef3b6faabfb None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:31.007669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:31.051992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae78ad9-54bd-4258-8195-3ef3b6faabfb None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:31.083849 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b20a60-00cd-4db6-9192-15c6209ccf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:31.084455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b20a60-00cd-4db6-9192-15c6209ccf9e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:31.084701 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b20a60-00cd-4db6-9192-15c6209ccf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:31.084967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b20a60-00cd-4db6-9192-15c6209ccf9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:31.152959 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b20a60-00cd-4db6-9192-15c6209ccf9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:31.154606 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b20a60-00cd-4db6-9192-15c6209ccf9e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:31.211590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:31.256465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 555/1093] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:31.262302 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39883ff6-82d6-43ab-8827-0f912ee0e531 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:31.363673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39883ff6-82d6-43ab-8827-0f912ee0e531 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:31.366308 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:31.403146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c007-8db0-4d48-8f34-d91e5a042ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:31.403778 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c007-8db0-4d48-8f34-d91e5a042ace None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:31.404075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c007-8db0-4d48-8f34-d91e5a042ace None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:31.404357 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c007-8db0-4d48-8f34-d91e5a042ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:31.415287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3c007-8db0-4d48-8f34-d91e5a042ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:31.416819 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3c007-8db0-4d48-8f34-d91e5a042ace None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-deb3c007-8db0-4d48-8f34-d91e5a042ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:31.432146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:31.433222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:44:31.434744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:31.434744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:44:31.434744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:31.434744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 539/1094] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:31.439090 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b20a60-00cd-4db6-9192-15c6209ccf9e None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:31.576034 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b20a60-00cd-4db6-9192-15c6209ccf9e None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:31.615675 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993873a-70e8-432c-bbd4-848189254042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:31.616405 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993873a-70e8-432c-bbd4-848189254042 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:31.616556 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993873a-70e8-432c-bbd4-848189254042 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:31.616828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993873a-70e8-432c-bbd4-848189254042 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:31.617480 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993873a-70e8-432c-bbd4-848189254042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:31.617781 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993873a-70e8-432c-bbd4-848189254042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:31.619195 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993873a-70e8-432c-bbd4-848189254042 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:31.632405 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 556/1095] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:31.638491 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c007-8db0-4d48-8f34-d91e5a042ace None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:31.721361 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a73068-ca7b-489c-be64-bca47343553b None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:31.721617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a73068-ca7b-489c-be64-bca47343553b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:31.721944 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a73068-ca7b-489c-be64-bca47343553b None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:31.723319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 557/1096] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:31.728487 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fdf89-81bc-48f9-8fae-60ee70de2cae None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:31.728780 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fdf89-81bc-48f9-8fae-60ee70de2cae None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:31.729048 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fdf89-81bc-48f9-8fae-60ee70de2cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:31.740388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c007-8db0-4d48-8f34-d91e5a042ace None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:31.747646 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-9d8fdf89-81bc-48f9-8fae-60ee70de2cae None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:31.748866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-9d8fdf89-81bc-48f9-8fae-60ee70de2cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:31.762118 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:31.777185 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61cf03-261d-4070-b96c-28338a2af6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:31.777812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61cf03-261d-4070-b96c-28338a2af6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:31.778114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61cf03-261d-4070-b96c-28338a2af6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:31.778380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61cf03-261d-4070-b96c-28338a2af6a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:31.785233 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61cf03-261d-4070-b96c-28338a2af6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:31.786676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61cf03-261d-4070-b96c-28338a2af6a8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7d61cf03-261d-4070-b96c-28338a2af6a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:44:31.798381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:31.799389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:31.800423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:44:31.800423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:44:31.800423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:44:31.800423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:44:31.800423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:44:31.800423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:44:31.800423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:44:31.800423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:31.800423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 540/1097] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:31.805589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61cf03-261d-4070-b96c-28338a2af6a8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:31.822809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 558/1098] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:31.823624 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:31.903201 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61cf03-261d-4070-b96c-28338a2af6a8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:31.937167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d79d-1a61-49d7-a847-dad3cafc290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:31.937774 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d79d-1a61-49d7-a847-dad3cafc290f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:31.938046 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d79d-1a61-49d7-a847-dad3cafc290f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:31.938316 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d79d-1a61-49d7-a847-dad3cafc290f None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:31.938988 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d79d-1a61-49d7-a847-dad3cafc290f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:31.939290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d79d-1a61-49d7-a847-dad3cafc290f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:31.940764 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d79d-1a61-49d7-a847-dad3cafc290f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:31.952641 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 541/1099] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:31.959123 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fdf89-81bc-48f9-8fae-60ee70de2cae None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:32.059644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fdf89-81bc-48f9-8fae-60ee70de2cae None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:32.084530 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d79d-1a61-49d7-a847-dad3cafc290f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:32.095050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63186094-368c-4437-a14a-ca7c39bce251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:32.095664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63186094-368c-4437-a14a-ca7c39bce251 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:32.095936 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63186094-368c-4437-a14a-ca7c39bce251 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:32.096223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63186094-368c-4437-a14a-ca7c39bce251 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:32.096958 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63186094-368c-4437-a14a-ca7c39bce251 None admin] RBAC: Adding query filter params (role.id=20ab666cb7654e36a5ca610eb516a482, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=f960fdabbffa4813a0ea46bb82218f09) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:32.097260 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63186094-368c-4437-a14a-ca7c39bce251 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:32.098978 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63186094-368c-4437-a14a-ca7c39bce251 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:32.104752 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 559/1100] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:31 2022] GET /identity/v3/role_assignments?user.id=f960fdabbffa4813a0ea46bb82218f09&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=20ab666cb7654e36a5ca610eb516a482 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:32.169122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:32.195192 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d79d-1a61-49d7-a847-dad3cafc290f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:32.235392 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d0c63-a103-4fdc-838e-0afd17717914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:32.236027 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d0c63-a103-4fdc-838e-0afd17717914 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:32.236331 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d0c63-a103-4fdc-838e-0afd17717914 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:32.236583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d0c63-a103-4fdc-838e-0afd17717914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:32.249154 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d0c63-a103-4fdc-838e-0afd17717914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-a59d0c63-a103-4fdc-838e-0afd17717914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:32.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:32.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:32.256890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 542/1101] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:44:32.262101 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63186094-368c-4437-a14a-ca7c39bce251 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:32.278272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:32.367691 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63186094-368c-4437-a14a-ca7c39bce251 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:32.400457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f67d7-1651-40a9-b13c-9099ca60f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:32.401059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f67d7-1651-40a9-b13c-9099ca60f022 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:32.401332 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f67d7-1651-40a9-b13c-9099ca60f022 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:32.401567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f67d7-1651-40a9-b13c-9099ca60f022 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:32.402237 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f67d7-1651-40a9-b13c-9099ca60f022 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:32.402539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f67d7-1651-40a9-b13c-9099ca60f022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:32.403866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f67d7-1651-40a9-b13c-9099ca60f022 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:32.413297 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 560/1102] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:32.421522 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d0c63-a103-4fdc-838e-0afd17717914 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:32.524890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d0c63-a103-4fdc-838e-0afd17717914 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:32.561010 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e96bb6-5bf8-4c07-a921-487cc4ad0d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:32.561618 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e96bb6-5bf8-4c07-a921-487cc4ad0d35 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:32.561903 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e96bb6-5bf8-4c07-a921-487cc4ad0d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:32.562168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e96bb6-5bf8-4c07-a921-487cc4ad0d35 None admin] PATH_INFO: `/v3/users/ff4276b097774e69a80740d9f84e6237` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:32.563351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e96bb6-5bf8-4c07-a921-487cc4ad0d35 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4276b097774e69a80740d9f84e6237)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:32.564843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e96bb6-5bf8-4c07-a921-487cc4ad0d35 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:32.566495 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 543/1103] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:32 2022] GET /identity/v3/users/ff4276b097774e69a80740d9f84e6237 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:32.573586 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f67d7-1651-40a9-b13c-9099ca60f022 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:32.656665 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:32.680932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f67d7-1651-40a9-b13c-9099ca60f022 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:32.714503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b785ba-65ae-41da-8233-912ca6ade789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:32.715188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b785ba-65ae-41da-8233-912ca6ade789 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:32.715463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b785ba-65ae-41da-8233-912ca6ade789 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:32.715726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b785ba-65ae-41da-8233-912ca6ade789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:32.783760 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b785ba-65ae-41da-8233-912ca6ade789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:32.785350 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b785ba-65ae-41da-8233-912ca6ade789 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:32.860327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:32.888822 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 561/1104] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:32.895221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e96bb6-5bf8-4c07-a921-487cc4ad0d35 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:32.899221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:32.995961 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e96bb6-5bf8-4c07-a921-487cc4ad0d35 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:33.028454 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907b4a4-eb7a-41c9-a2d7-946c9d1ef616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:33.029065 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b4a4-eb7a-41c9-a2d7-946c9d1ef616 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:33.029366 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b4a4-eb7a-41c9-a2d7-946c9d1ef616 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:33.029630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b4a4-eb7a-41c9-a2d7-946c9d1ef616 None admin] PATH_INFO: `/v3/projects/3cb644dd1e874438b662f654ea913b62` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:33.030803 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907b4a4-eb7a-41c9-a2d7-946c9d1ef616 None admin] RBAC: Authorizing `identity:get_project(project_id=3cb644dd1e874438b662f654ea913b62)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:33.032267 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907b4a4-eb7a-41c9-a2d7-946c9d1ef616 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:33.033869 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 544/1105] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:32 2022] GET /identity/v3/projects/3cb644dd1e874438b662f654ea913b62 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:33.040605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b785ba-65ae-41da-8233-912ca6ade789 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:33.139761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b785ba-65ae-41da-8233-912ca6ade789 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:33.174213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89003f50-f74b-4bbf-b278-5c8b8de6732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:33.174794 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89003f50-f74b-4bbf-b278-5c8b8de6732b None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:33.175060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89003f50-f74b-4bbf-b278-5c8b8de6732b None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:33.175317 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89003f50-f74b-4bbf-b278-5c8b8de6732b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:33.176279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89003f50-f74b-4bbf-b278-5c8b8de6732b None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=3cb644dd1e874438b662f654ea913b62, user.id=ff4276b097774e69a80740d9f84e6237) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:33.176433 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89003f50-f74b-4bbf-b278-5c8b8de6732b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:33.177859 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89003f50-f74b-4bbf-b278-5c8b8de6732b None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:33.183534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 562/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:33 2022] GET /identity/v3/role_assignments?user.id=ff4276b097774e69a80740d9f84e6237&scope.project.id=3cb644dd1e874438b662f654ea913b62&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:35.348524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0422-7f48-45f9-9775-571d84324e0b None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:35.349420 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0422-7f48-45f9-9775-571d84324e0b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:35.349420 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0422-7f48-45f9-9775-571d84324e0b None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:35.351571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 545/1107] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:35.360605 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3dc2-11a8-409c-8f2e-ce7e99c5d6dd None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:35.361297 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3dc2-11a8-409c-8f2e-ce7e99c5d6dd None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:35.361478 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3dc2-11a8-409c-8f2e-ce7e99c5d6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:35.382393 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-766f3dc2-11a8-409c-8f2e-ce7e99c5d6dd None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:35.383576 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-766f3dc2-11a8-409c-8f2e-ce7e99c5d6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:35.415399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:35.454193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 563/1108] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:35.720855 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d0422-7f48-45f9-9775-571d84324e0b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:35.810442 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:35.841389 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d0422-7f48-45f9-9775-571d84324e0b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:35.875665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed65ab-add1-4382-812c-7d24928b4391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:35.876349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed65ab-add1-4382-812c-7d24928b4391 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:35.876625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed65ab-add1-4382-812c-7d24928b4391 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:35.876892 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed65ab-add1-4382-812c-7d24928b4391 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:35.878122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed65ab-add1-4382-812c-7d24928b4391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:35.879674 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed65ab-add1-4382-812c-7d24928b4391 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:35.881597 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 546/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:35.887797 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f3dc2-11a8-409c-8f2e-ce7e99c5d6dd None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:35.996972 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f3dc2-11a8-409c-8f2e-ce7e99c5d6dd None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:36.032700 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f7bd0-40ae-4c35-ada5-cb64220d45e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:36.033286 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7bd0-40ae-4c35-ada5-cb64220d45e3 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:36.033561 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7bd0-40ae-4c35-ada5-cb64220d45e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:36.033828 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7bd0-40ae-4c35-ada5-cb64220d45e3 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:36.034467 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f7bd0-40ae-4c35-ada5-cb64220d45e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:36.035919 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f7bd0-40ae-4c35-ada5-cb64220d45e3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:36.061400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 564/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:44:35 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:38.219493 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c7c8c-97fa-4069-8fe5-671c728797d9 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:38.220076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c7c8c-97fa-4069-8fe5-671c728797d9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:38.220076 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c7c8c-97fa-4069-8fe5-671c728797d9 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:38.221403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 547/1111] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:38.227869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634487c-3303-4ecc-bccb-b81594eae933 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:38.228600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634487c-3303-4ecc-bccb-b81594eae933 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:38.228777 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634487c-3303-4ecc-bccb-b81594eae933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:38.257714 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-f634487c-3303-4ecc-bccb-b81594eae933 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:38.258887 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-f634487c-3303-4ecc-bccb-b81594eae933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:38.278903 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:38.330612 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 565/1112] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:38.626364 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c7c8c-97fa-4069-8fe5-671c728797d9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:38.746317 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c7c8c-97fa-4069-8fe5-671c728797d9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:38.783254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c2f09-1abb-44fb-ac3f-9be9e5fd8e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:38.783878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c2f09-1abb-44fb-ac3f-9be9e5fd8e01 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:38.784192 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c2f09-1abb-44fb-ac3f-9be9e5fd8e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:38.784463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c2f09-1abb-44fb-ac3f-9be9e5fd8e01 None admin] PATH_INFO: `/v3/roles/d796a9636e044b848ecdc0f80ee9443d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:38.786243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c2f09-1abb-44fb-ac3f-9be9e5fd8e01 None admin] RBAC: Authorizing `identity:get_role(role_id=d796a9636e044b848ecdc0f80ee9443d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:38.787630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c2f09-1abb-44fb-ac3f-9be9e5fd8e01 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:38.789034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 548/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:38 2022] GET /identity/v3/roles/d796a9636e044b848ecdc0f80ee9443d => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:38.795228 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634487c-3303-4ecc-bccb-b81594eae933 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:38.902909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634487c-3303-4ecc-bccb-b81594eae933 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:38.940534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e19680-fab7-4c25-9e61-383a5be99b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:38.941216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e19680-fab7-4c25-9e61-383a5be99b62 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:38.941566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e19680-fab7-4c25-9e61-383a5be99b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:38.941949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e19680-fab7-4c25-9e61-383a5be99b62 None admin] PATH_INFO: `/v3/users/6c967c23ed48423aa8618be64ce504aa` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:38.958182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e19680-fab7-4c25-9e61-383a5be99b62 None admin] RBAC: Authorizing `identity:get_user(user_id=6c967c23ed48423aa8618be64ce504aa)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:38.959737 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e19680-fab7-4c25-9e61-383a5be99b62 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:38.961471 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 566/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:38 2022] GET /identity/v3/users/6c967c23ed48423aa8618be64ce504aa => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:38.967794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c2f09-1abb-44fb-ac3f-9be9e5fd8e01 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:38.979777 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:39.072960 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c2f09-1abb-44fb-ac3f-9be9e5fd8e01 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:39.107252 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00966c85-924b-492b-a938-2735975f3c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:39.107850 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00966c85-924b-492b-a938-2735975f3c82 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:39.108147 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00966c85-924b-492b-a938-2735975f3c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:39.108414 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00966c85-924b-492b-a938-2735975f3c82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:39.176880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00966c85-924b-492b-a938-2735975f3c82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:39.178254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00966c85-924b-492b-a938-2735975f3c82 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:39.187673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:39.281697 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 549/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:39.288194 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e19680-fab7-4c25-9e61-383a5be99b62 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:39.308911 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:39.406108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e19680-fab7-4c25-9e61-383a5be99b62 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:39.442359 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96ad6d-b603-404b-a1c8-d8b46aa4fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:39.442912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96ad6d-b603-404b-a1c8-d8b46aa4fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:39.443181 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96ad6d-b603-404b-a1c8-d8b46aa4fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:39.443442 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96ad6d-b603-404b-a1c8-d8b46aa4fdd2 None admin] PATH_INFO: `/v3/projects/3cb644dd1e874438b662f654ea913b62` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:39.444653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96ad6d-b603-404b-a1c8-d8b46aa4fdd2 None admin] RBAC: Authorizing `identity:get_project(project_id=3cb644dd1e874438b662f654ea913b62)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:39.446063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96ad6d-b603-404b-a1c8-d8b46aa4fdd2 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:39.447671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 567/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:39 2022] GET /identity/v3/projects/3cb644dd1e874438b662f654ea913b62 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:39.454027 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00966c85-924b-492b-a938-2735975f3c82 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:39.558431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00966c85-924b-492b-a938-2735975f3c82 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:39.568164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:39.608519 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033adcf1-edd2-4756-aaa6-546adf082e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:39.609135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033adcf1-edd2-4756-aaa6-546adf082e17 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:39.609403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033adcf1-edd2-4756-aaa6-546adf082e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:39.609674 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033adcf1-edd2-4756-aaa6-546adf082e17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:39.610407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033adcf1-edd2-4756-aaa6-546adf082e17 None admin] RBAC: Adding query filter params (role.id=d796a9636e044b848ecdc0f80ee9443d, scope.project.id=3cb644dd1e874438b662f654ea913b62, user.id=6c967c23ed48423aa8618be64ce504aa) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:39.610711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033adcf1-edd2-4756-aaa6-546adf082e17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:39.612152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033adcf1-edd2-4756-aaa6-546adf082e17 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:39.617547 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 550/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:39 2022] GET /identity/v3/role_assignments?user.id=6c967c23ed48423aa8618be64ce504aa&scope.project.id=3cb644dd1e874438b662f654ea913b62&role.id=d796a9636e044b848ecdc0f80ee9443d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:41.709622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9072a-23ba-4e66-aea7-1076412e202a None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:41.710518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9072a-23ba-4e66-aea7-1076412e202a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:41.710518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9072a-23ba-4e66-aea7-1076412e202a None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:41.712667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 568/1118] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:41.721480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168d831-e1e9-4d9a-a112-df4bf3e9b659 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:41.722181 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168d831-e1e9-4d9a-a112-df4bf3e9b659 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:41.722380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168d831-e1e9-4d9a-a112-df4bf3e9b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:41.742160 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b168d831-e1e9-4d9a-a112-df4bf3e9b659 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:41.743341 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b168d831-e1e9-4d9a-a112-df4bf3e9b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:41.817688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 551/1119] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:42.078348 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9072a-23ba-4e66-aea7-1076412e202a None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:42.184396 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:42.206263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9072a-23ba-4e66-aea7-1076412e202a None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:42.239947 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9b7b1-a279-4ae6-ac9a-5b52c37ae424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:42.240592 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9b7b1-a279-4ae6-ac9a-5b52c37ae424 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:42.240865 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9b7b1-a279-4ae6-ac9a-5b52c37ae424 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:42.241135 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9b7b1-a279-4ae6-ac9a-5b52c37ae424 None admin] PATH_INFO: `/v3/roles/d796a9636e044b848ecdc0f80ee9443d` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:42.242636 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9b7b1-a279-4ae6-ac9a-5b52c37ae424 None admin] RBAC: Authorizing `identity:get_role(role_id=d796a9636e044b848ecdc0f80ee9443d)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:42.244000 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9b7b1-a279-4ae6-ac9a-5b52c37ae424 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:42.245345 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 569/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:42 2022] GET /identity/v3/roles/d796a9636e044b848ecdc0f80ee9443d => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:42.251525 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168d831-e1e9-4d9a-a112-df4bf3e9b659 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:42.354046 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168d831-e1e9-4d9a-a112-df4bf3e9b659 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:42.355553 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:42.390546 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652cf28-b914-4b19-8e3a-4541ae8bda1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:42.391181 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652cf28-b914-4b19-8e3a-4541ae8bda1e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:42.391462 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652cf28-b914-4b19-8e3a-4541ae8bda1e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:42.391736 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652cf28-b914-4b19-8e3a-4541ae8bda1e None admin] PATH_INFO: `/v3/users/6c967c23ed48423aa8618be64ce504aa` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:42.393036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652cf28-b914-4b19-8e3a-4541ae8bda1e None admin] RBAC: Authorizing `identity:get_user(user_id=6c967c23ed48423aa8618be64ce504aa)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:42.394627 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652cf28-b914-4b19-8e3a-4541ae8bda1e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:42.396452 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 552/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:42 2022] GET /identity/v3/users/6c967c23ed48423aa8618be64ce504aa => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:42.403111 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9b7b1-a279-4ae6-ac9a-5b52c37ae424 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:42.511600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9b7b1-a279-4ae6-ac9a-5b52c37ae424 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:42.546866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5edb88-f5c3-4d81-a023-b7d3bcfbb75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:42.547480 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5edb88-f5c3-4d81-a023-b7d3bcfbb75d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:42.547743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5edb88-f5c3-4d81-a023-b7d3bcfbb75d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:42.548004 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5edb88-f5c3-4d81-a023-b7d3bcfbb75d None admin] PATH_INFO: `/v3/projects/3cb644dd1e874438b662f654ea913b62` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:42.549196 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5edb88-f5c3-4d81-a023-b7d3bcfbb75d None admin] RBAC: Authorizing `identity:get_project(project_id=3cb644dd1e874438b662f654ea913b62)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:42.550629 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5edb88-f5c3-4d81-a023-b7d3bcfbb75d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:42.552355 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 570/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:42 2022] GET /identity/v3/projects/3cb644dd1e874438b662f654ea913b62 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:42.562397 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652cf28-b914-4b19-8e3a-4541ae8bda1e None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:42.673788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652cf28-b914-4b19-8e3a-4541ae8bda1e None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:42.711568 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54747bf7-a77b-498d-b5bb-d5af8663e484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:42.712242 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747bf7-a77b-498d-b5bb-d5af8663e484 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:42.712518 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747bf7-a77b-498d-b5bb-d5af8663e484 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:42.712791 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747bf7-a77b-498d-b5bb-d5af8663e484 None admin] PATH_INFO: `/v3/projects/3cb644dd1e874438b662f654ea913b62/users/6c967c23ed48423aa8618be64ce504aa/roles/d796a9636e044b848ecdc0f80ee9443d` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:42.715169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54747bf7-a77b-498d-b5bb-d5af8663e484 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cb644dd1e874438b662f654ea913b62, user_id=6c967c23ed48423aa8618be64ce504aa, role_id=d796a9636e044b848ecdc0f80ee9443d)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:42.716623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54747bf7-a77b-498d-b5bb-d5af8663e484 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:42.732950 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 553/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:44:42 2022] PUT /identity/v3/projects/3cb644dd1e874438b662f654ea913b62/users/6c967c23ed48423aa8618be64ce504aa/roles/d796a9636e044b848ecdc0f80ee9443d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:44:44.860366 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308c36e-ebd6-4df5-9c8d-462e906f3a67 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:44.861222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308c36e-ebd6-4df5-9c8d-462e906f3a67 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:44.861222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308c36e-ebd6-4df5-9c8d-462e906f3a67 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:44.863345 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 571/1124] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:44.868947 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458f4cd-749b-4d34-81b8-917c10c2887a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:44.869393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458f4cd-749b-4d34-81b8-917c10c2887a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:44.869494 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458f4cd-749b-4d34-81b8-917c10c2887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:44.889503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8458f4cd-749b-4d34-81b8-917c10c2887a None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:44.890707 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8458f4cd-749b-4d34-81b8-917c10c2887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:44.915748 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:44.971037 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 554/1125] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:45.258924 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308c36e-ebd6-4df5-9c8d-462e906f3a67 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:45.287566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:45.381452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308c36e-ebd6-4df5-9c8d-462e906f3a67 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:45.416064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6702c-87c2-4274-82f5-9c362bbc1bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:45.416695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6702c-87c2-4274-82f5-9c362bbc1bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:45.416961 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6702c-87c2-4274-82f5-9c362bbc1bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:45.417220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6702c-87c2-4274-82f5-9c362bbc1bd3 None admin] PATH_INFO: `/v3/roles/d796a9636e044b848ecdc0f80ee9443d` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:45.418703 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6702c-87c2-4274-82f5-9c362bbc1bd3 None admin] RBAC: Authorizing `identity:get_role(role_id=d796a9636e044b848ecdc0f80ee9443d)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:45.420086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6702c-87c2-4274-82f5-9c362bbc1bd3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:45.421380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 572/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:45 2022] GET /identity/v3/roles/d796a9636e044b848ecdc0f80ee9443d => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:45.428333 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458f4cd-749b-4d34-81b8-917c10c2887a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:45.541036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458f4cd-749b-4d34-81b8-917c10c2887a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:45.575395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f6e71-43a0-4c2b-9161-454772bfeee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:45.576014 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f6e71-43a0-4c2b-9161-454772bfeee9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:45.576322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f6e71-43a0-4c2b-9161-454772bfeee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:45.576590 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f6e71-43a0-4c2b-9161-454772bfeee9 None admin] PATH_INFO: `/v3/users/6c967c23ed48423aa8618be64ce504aa` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:45.577793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f6e71-43a0-4c2b-9161-454772bfeee9 None admin] RBAC: Authorizing `identity:get_user(user_id=6c967c23ed48423aa8618be64ce504aa)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:45.579232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f6e71-43a0-4c2b-9161-454772bfeee9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:45.580839 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 555/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:45 2022] GET /identity/v3/users/6c967c23ed48423aa8618be64ce504aa => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:45.587002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6702c-87c2-4274-82f5-9c362bbc1bd3 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:45.685960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:45.702935 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6702c-87c2-4274-82f5-9c362bbc1bd3 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:45.743100 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01c37e-1503-46ee-81fd-4596efe05ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:45.743978 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c37e-1503-46ee-81fd-4596efe05ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:45.744385 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c37e-1503-46ee-81fd-4596efe05ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:45.744723 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c37e-1503-46ee-81fd-4596efe05ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:45.822643 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01c37e-1503-46ee-81fd-4596efe05ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:45.824119 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01c37e-1503-46ee-81fd-4596efe05ed6 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:45.908612 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:45.927852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 573/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:45.934180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f6e71-43a0-4c2b-9161-454772bfeee9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:45.965249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:46.041300 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f6e71-43a0-4c2b-9161-454772bfeee9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:46.076351 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839e0ac-a3c3-42bf-ac2a-d6f88fbb43ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:46.076895 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839e0ac-a3c3-42bf-ac2a-d6f88fbb43ba None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:46.077149 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839e0ac-a3c3-42bf-ac2a-d6f88fbb43ba None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:46.077427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839e0ac-a3c3-42bf-ac2a-d6f88fbb43ba None admin] PATH_INFO: `/v3/projects/3cb644dd1e874438b662f654ea913b62` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:46.078576 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839e0ac-a3c3-42bf-ac2a-d6f88fbb43ba None admin] RBAC: Authorizing `identity:get_project(project_id=3cb644dd1e874438b662f654ea913b62)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:46.080022 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839e0ac-a3c3-42bf-ac2a-d6f88fbb43ba None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:46.081644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 556/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:45 2022] GET /identity/v3/projects/3cb644dd1e874438b662f654ea913b62 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:46.088188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01c37e-1503-46ee-81fd-4596efe05ed6 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:46.187784 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01c37e-1503-46ee-81fd-4596efe05ed6 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:46.223542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771747-0ecc-403f-a24d-96c5f95c5524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:46.224166 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771747-0ecc-403f-a24d-96c5f95c5524 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:46.224442 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771747-0ecc-403f-a24d-96c5f95c5524 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:46.224711 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771747-0ecc-403f-a24d-96c5f95c5524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:46.225424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7771747-0ecc-403f-a24d-96c5f95c5524 None admin] RBAC: Adding query filter params (role.id=d796a9636e044b848ecdc0f80ee9443d, scope.project.id=3cb644dd1e874438b662f654ea913b62, user.id=6c967c23ed48423aa8618be64ce504aa) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:46.225724 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7771747-0ecc-403f-a24d-96c5f95c5524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:46.227154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7771747-0ecc-403f-a24d-96c5f95c5524 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:46.232998 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 574/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:46 2022] GET /identity/v3/role_assignments?user.id=6c967c23ed48423aa8618be64ce504aa&scope.project.id=3cb644dd1e874438b662f654ea913b62&role.id=d796a9636e044b848ecdc0f80ee9443d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:48.366183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ff5de-3d42-497a-98b7-9bfbca741748 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:48.367085 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ff5de-3d42-497a-98b7-9bfbca741748 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:48.367085 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ff5de-3d42-497a-98b7-9bfbca741748 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:48.369154 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 557/1131] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:48.377976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36e933-ea85-4850-839b-b2b38401d7ef None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:48.378398 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36e933-ea85-4850-839b-b2b38401d7ef None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:48.378557 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36e933-ea85-4850-839b-b2b38401d7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:48.405550 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-3f36e933-ea85-4850-839b-b2b38401d7ef None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:48.406745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3f36e933-ea85-4850-839b-b2b38401d7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:48.455261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:48.486180 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 575/1132] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:48.750330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ff5de-3d42-497a-98b7-9bfbca741748 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:48.855531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:48.864292 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ff5de-3d42-497a-98b7-9bfbca741748 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:48.900147 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791b374-eead-4d8f-a8de-665b5e888d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:48.900763 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b374-eead-4d8f-a8de-665b5e888d17 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:48.901034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b374-eead-4d8f-a8de-665b5e888d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:48.901299 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b374-eead-4d8f-a8de-665b5e888d17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:48.902440 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791b374-eead-4d8f-a8de-665b5e888d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:48.903892 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791b374-eead-4d8f-a8de-665b5e888d17 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:48.905631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 558/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:48.915444 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36e933-ea85-4850-839b-b2b38401d7ef None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:49.020613 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36e933-ea85-4850-839b-b2b38401d7ef None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:49.055405 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74f045-a08c-46d9-8549-0fbd9d193421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:49.056005 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74f045-a08c-46d9-8549-0fbd9d193421 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:49.056281 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74f045-a08c-46d9-8549-0fbd9d193421 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:49.056575 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74f045-a08c-46d9-8549-0fbd9d193421 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:49.057207 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74f045-a08c-46d9-8549-0fbd9d193421 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:49.058619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74f045-a08c-46d9-8549-0fbd9d193421 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:49.087905 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 576/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:44:48 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:51.242261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb634d-9d6d-4aec-8893-808bcccd9461 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:51.243117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb634d-9d6d-4aec-8893-808bcccd9461 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:51.243117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb634d-9d6d-4aec-8893-808bcccd9461 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:51.245311 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 559/1135] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:51.250906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d1b20-e15b-4692-814c-cad2c322a9e7 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:51.251352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d1b20-e15b-4692-814c-cad2c322a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:51.251446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d1b20-e15b-4692-814c-cad2c322a9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:51.271979 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-9c9d1b20-e15b-4692-814c-cad2c322a9e7 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:51.273166 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-9c9d1b20-e15b-4692-814c-cad2c322a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:51.296699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:51.343599 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 577/1136] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:51.609388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb634d-9d6d-4aec-8893-808bcccd9461 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:51.729657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb634d-9d6d-4aec-8893-808bcccd9461 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:51.766197 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695ffee-5b1e-4c7c-b618-71cab6b16dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:51.766810 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ffee-5b1e-4c7c-b618-71cab6b16dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:51.767086 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ffee-5b1e-4c7c-b618-71cab6b16dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:51.767348 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ffee-5b1e-4c7c-b618-71cab6b16dd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:51.768618 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695ffee-5b1e-4c7c-b618-71cab6b16dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:51.770114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695ffee-5b1e-4c7c-b618-71cab6b16dd9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:51.771690 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 560/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:51.778378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d1b20-e15b-4692-814c-cad2c322a9e7 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:51.893860 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d1b20-e15b-4692-814c-cad2c322a9e7 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:51.928313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a085d-87d4-4e3d-ba79-d021b949e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:51.928914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a085d-87d4-4e3d-ba79-d021b949e230 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:51.929186 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a085d-87d4-4e3d-ba79-d021b949e230 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:51.929448 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a085d-87d4-4e3d-ba79-d021b949e230 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:51.930091 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a085d-87d4-4e3d-ba79-d021b949e230 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:51.931507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a085d-87d4-4e3d-ba79-d021b949e230 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:51.958152 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 578/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:44:51 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:54.162808 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df13a-70d0-47ef-ab87-4bee5b755a94 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:54.163646 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df13a-70d0-47ef-ab87-4bee5b755a94 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:54.163646 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df13a-70d0-47ef-ab87-4bee5b755a94 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:54.165755 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 561/1139] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:54.172359 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79386e9c-0294-454d-b196-09569586f53f None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:54.173031 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79386e9c-0294-454d-b196-09569586f53f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:54.173184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79386e9c-0294-454d-b196-09569586f53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:54.194469 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-79386e9c-0294-454d-b196-09569586f53f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:54.195650 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-79386e9c-0294-454d-b196-09569586f53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:54.206478 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:54.275458 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 579/1140] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:54.540812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34df13a-70d0-47ef-ab87-4bee5b755a94 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:54.581826 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:54.664504 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34df13a-70d0-47ef-ab87-4bee5b755a94 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:54.706453 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06600965-51f8-4ee0-8c97-736b4f528efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:54.707083 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600965-51f8-4ee0-8c97-736b4f528efa None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:54.707356 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600965-51f8-4ee0-8c97-736b4f528efa None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:54.707618 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600965-51f8-4ee0-8c97-736b4f528efa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:54.717853 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06600965-51f8-4ee0-8c97-736b4f528efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-06600965-51f8-4ee0-8c97-736b4f528efa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:54.722687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:54.723874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:54.725975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 562/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:54.733003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79386e9c-0294-454d-b196-09569586f53f None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:54.839928 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79386e9c-0294-454d-b196-09569586f53f None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:54.876963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ebb8a-1f8d-4f08-a960-47ec3c71ed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:54.877560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ebb8a-1f8d-4f08-a960-47ec3c71ed14 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:54.877835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ebb8a-1f8d-4f08-a960-47ec3c71ed14 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:54.878109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ebb8a-1f8d-4f08-a960-47ec3c71ed14 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:54.878966 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ebb8a-1f8d-4f08-a960-47ec3c71ed14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:54.879299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ebb8a-1f8d-4f08-a960-47ec3c71ed14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:54.881009 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ebb8a-1f8d-4f08-a960-47ec3c71ed14 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:54.888939 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 580/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:54.897462 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06600965-51f8-4ee0-8c97-736b4f528efa None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:55.007219 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:55.020986 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06600965-51f8-4ee0-8c97-736b4f528efa None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:55.055760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12321f-6b3a-4edc-895d-79a7d68989e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:55.056338 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12321f-6b3a-4edc-895d-79a7d68989e2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:55.056611 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12321f-6b3a-4edc-895d-79a7d68989e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:55.056878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12321f-6b3a-4edc-895d-79a7d68989e2 None admin] PATH_INFO: `/v3/users/20f10c667048482ebfaee906ae949ee2` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:55.070248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12321f-6b3a-4edc-895d-79a7d68989e2 None admin] RBAC: Authorizing `identity:get_user(user_id=20f10c667048482ebfaee906ae949ee2)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:55.071701 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12321f-6b3a-4edc-895d-79a7d68989e2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:55.073311 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 563/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:54 2022] GET /identity/v3/users/20f10c667048482ebfaee906ae949ee2 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:55.079909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ebb8a-1f8d-4f08-a960-47ec3c71ed14 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:55.093275 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:55.189902 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ebb8a-1f8d-4f08-a960-47ec3c71ed14 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:55.224974 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c79cd1-d247-499f-b328-4f3a5f68e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:55.225571 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79cd1-d247-499f-b328-4f3a5f68e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:55.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79cd1-d247-499f-b328-4f3a5f68e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:55.226113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79cd1-d247-499f-b328-4f3a5f68e4a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:55.302509 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c79cd1-d247-499f-b328-4f3a5f68e4a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:55.304750 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c79cd1-d247-499f-b328-4f3a5f68e4a5 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:55.319250 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:55.412741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 581/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:55.422355 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12321f-6b3a-4edc-895d-79a7d68989e2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:55.531091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12321f-6b3a-4edc-895d-79a7d68989e2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:55.567983 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3f9d9-1dd3-45b5-8efc-c7b6e836c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:55.568629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f9d9-1dd3-45b5-8efc-c7b6e836c1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:55.568899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f9d9-1dd3-45b5-8efc-c7b6e836c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:55.569165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f9d9-1dd3-45b5-8efc-c7b6e836c1c7 None admin] PATH_INFO: `/v3/projects/fa6414fbea4044ddaa4f9484f1162b9a` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:55.570441 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3f9d9-1dd3-45b5-8efc-c7b6e836c1c7 None admin] RBAC: Authorizing `identity:get_project(project_id=fa6414fbea4044ddaa4f9484f1162b9a)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:55.571806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3f9d9-1dd3-45b5-8efc-c7b6e836c1c7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:55.573428 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 564/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:55 2022] GET /identity/v3/projects/fa6414fbea4044ddaa4f9484f1162b9a => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:55.580472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c79cd1-d247-499f-b328-4f3a5f68e4a5 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:55.689425 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c79cd1-d247-499f-b328-4f3a5f68e4a5 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:55.699527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:55.731600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9a2ea-6b09-4abf-be1a-3bc736dbb38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:55.732232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9a2ea-6b09-4abf-be1a-3bc736dbb38c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:55.732503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9a2ea-6b09-4abf-be1a-3bc736dbb38c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:55.732761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9a2ea-6b09-4abf-be1a-3bc736dbb38c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:55.733464 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9a2ea-6b09-4abf-be1a-3bc736dbb38c None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=fa6414fbea4044ddaa4f9484f1162b9a, user.id=20f10c667048482ebfaee906ae949ee2) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:55.733758 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9a2ea-6b09-4abf-be1a-3bc736dbb38c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:55.735173 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9a2ea-6b09-4abf-be1a-3bc736dbb38c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:55.741448 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 582/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:55 2022] GET /identity/v3/role_assignments?user.id=20f10c667048482ebfaee906ae949ee2&scope.project.id=fa6414fbea4044ddaa4f9484f1162b9a&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:57.853981 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea378f5-921f-4e78-bc4a-ac62b981b887 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:57.854502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea378f5-921f-4e78-bc4a-ac62b981b887 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:57.854502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea378f5-921f-4e78-bc4a-ac62b981b887 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:57.855865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 565/1147] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:57.861344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfeda4-6344-4be2-a724-2620aa7af879 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:57.861768 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfeda4-6344-4be2-a724-2620aa7af879 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:57.861858 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfeda4-6344-4be2-a724-2620aa7af879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:57.882741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-85dfeda4-6344-4be2-a724-2620aa7af879 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:57.883924 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-85dfeda4-6344-4be2-a724-2620aa7af879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:57.953565 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 583/1148] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:58.219916 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea378f5-921f-4e78-bc4a-ac62b981b887 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:58.244876 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:58.340665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea378f5-921f-4e78-bc4a-ac62b981b887 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:58.384792 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7e1ba-e5be-43be-8c43-6385cf09e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:58.385507 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7e1ba-e5be-43be-8c43-6385cf09e0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:58.385947 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7e1ba-e5be-43be-8c43-6385cf09e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:58.386299 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7e1ba-e5be-43be-8c43-6385cf09e0a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:58.400806 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7e1ba-e5be-43be-8c43-6385cf09e0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-4bc7e1ba-e5be-43be-8c43-6385cf09e0a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:58.405634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:58.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:44:58.408854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 566/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:44:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:58.416848 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfeda4-6344-4be2-a724-2620aa7af879 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:58.542860 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfeda4-6344-4be2-a724-2620aa7af879 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:58.544521 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:58.587093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d13bd6-20f5-44d6-8817-73ff0417cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:58.587706 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d13bd6-20f5-44d6-8817-73ff0417cd9c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:58.587975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d13bd6-20f5-44d6-8817-73ff0417cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:58.588271 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d13bd6-20f5-44d6-8817-73ff0417cd9c None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:58.588924 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d13bd6-20f5-44d6-8817-73ff0417cd9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:58.589213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d13bd6-20f5-44d6-8817-73ff0417cd9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:58.591066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d13bd6-20f5-44d6-8817-73ff0417cd9c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:58.600077 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 584/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:58.609125 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7e1ba-e5be-43be-8c43-6385cf09e0a3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:58.715562 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:58.747508 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7e1ba-e5be-43be-8c43-6385cf09e0a3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:58.794249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0864d-e408-453e-9396-1b306db71ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:58.795245 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0864d-e408-453e-9396-1b306db71ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:58.795531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0864d-e408-453e-9396-1b306db71ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:58.795803 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0864d-e408-453e-9396-1b306db71ca1 None admin] PATH_INFO: `/v3/users/20f10c667048482ebfaee906ae949ee2` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:58.797060 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0864d-e408-453e-9396-1b306db71ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=20f10c667048482ebfaee906ae949ee2)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:58.798480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0864d-e408-453e-9396-1b306db71ca1 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:58.800093 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 567/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:58 2022] GET /identity/v3/users/20f10c667048482ebfaee906ae949ee2 => generated 286 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:58.807625 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d13bd6-20f5-44d6-8817-73ff0417cd9c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:58.944589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d13bd6-20f5-44d6-8817-73ff0417cd9c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:58.984323 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cd428-346a-41c5-9abd-00c01b61624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:58.985188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cd428-346a-41c5-9abd-00c01b61624e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:58.985188 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cd428-346a-41c5-9abd-00c01b61624e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:58.985647 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cd428-346a-41c5-9abd-00c01b61624e None admin] PATH_INFO: `/v3/projects/fa6414fbea4044ddaa4f9484f1162b9a` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:58.986687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cd428-346a-41c5-9abd-00c01b61624e None admin] RBAC: Authorizing `identity:get_project(project_id=fa6414fbea4044ddaa4f9484f1162b9a)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:58.988015 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cd428-346a-41c5-9abd-00c01b61624e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:58.989657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 585/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:58 2022] GET /identity/v3/projects/fa6414fbea4044ddaa4f9484f1162b9a => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:58.999526 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0864d-e408-453e-9396-1b306db71ca1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:59.130964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0864d-e408-453e-9396-1b306db71ca1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:59.178533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2887cf-347a-4ea4-aa78-d982139b83b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:59.179253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2887cf-347a-4ea4-aa78-d982139b83b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:59.179556 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2887cf-347a-4ea4-aa78-d982139b83b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:59.180021 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2887cf-347a-4ea4-aa78-d982139b83b5 None admin] PATH_INFO: `/v3/projects/fa6414fbea4044ddaa4f9484f1162b9a/users/20f10c667048482ebfaee906ae949ee2/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:59.182656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2887cf-347a-4ea4-aa78-d982139b83b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa6414fbea4044ddaa4f9484f1162b9a, user_id=20f10c667048482ebfaee906ae949ee2, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:59.184271 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2887cf-347a-4ea4-aa78-d982139b83b5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:59.202721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 568/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:44:58 2022] PUT /identity/v3/projects/fa6414fbea4044ddaa4f9484f1162b9a/users/20f10c667048482ebfaee906ae949ee2/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:45:01.331811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96438d-3004-421a-9dc9-1ffe06bb696b None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:01.332827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96438d-3004-421a-9dc9-1ffe06bb696b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:01.332827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96438d-3004-421a-9dc9-1ffe06bb696b None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:01.334854 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 586/1154] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:45:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:45:01.342950 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4f62-6ebb-4371-8ab4-3f613a86f5ec None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:01.343418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4f62-6ebb-4371-8ab4-3f613a86f5ec None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:01.343529 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4f62-6ebb-4371-8ab4-3f613a86f5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:01.357625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:01.363348 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-cddc4f62-6ebb-4371-8ab4-3f613a86f5ec None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:01.365110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cddc4f62-6ebb-4371-8ab4-3f613a86f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:01.435759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 569/1155] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:45:01.703305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96438d-3004-421a-9dc9-1ffe06bb696b None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:01.742243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:01.825335 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96438d-3004-421a-9dc9-1ffe06bb696b None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:01.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96775a4-83bd-4c26-b04d-b09f6d353ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:01.861764 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96775a4-83bd-4c26-b04d-b09f6d353ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:01.862010 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96775a4-83bd-4c26-b04d-b09f6d353ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:01.862304 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96775a4-83bd-4c26-b04d-b09f6d353ec4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:01.873468 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96775a4-83bd-4c26-b04d-b09f6d353ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-b96775a4-83bd-4c26-b04d-b09f6d353ec4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:45:01.878344 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:01.879530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:45:01.880898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 587/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:45:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:01.886254 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc4f62-6ebb-4371-8ab4-3f613a86f5ec None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:01.990327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc4f62-6ebb-4371-8ab4-3f613a86f5ec None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:02.027099 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1d04e-1cc9-4d7c-bce4-5b2a63d3d36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:02.027695 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1d04e-1cc9-4d7c-bce4-5b2a63d3d36f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:02.027970 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1d04e-1cc9-4d7c-bce4-5b2a63d3d36f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:02.028267 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1d04e-1cc9-4d7c-bce4-5b2a63d3d36f None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:02.028921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1d04e-1cc9-4d7c-bce4-5b2a63d3d36f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:02.029224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1d04e-1cc9-4d7c-bce4-5b2a63d3d36f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:02.030596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1d04e-1cc9-4d7c-bce4-5b2a63d3d36f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:02.032807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:02.039466 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 570/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:45:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:02.045551 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96775a4-83bd-4c26-b04d-b09f6d353ec4 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:02.140557 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:02.150665 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96775a4-83bd-4c26-b04d-b09f6d353ec4 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:02.184824 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fe47b-fb26-40c7-9c48-cd644893e747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:02.185434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe47b-fb26-40c7-9c48-cd644893e747 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:02.185707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe47b-fb26-40c7-9c48-cd644893e747 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:02.185974 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe47b-fb26-40c7-9c48-cd644893e747 None admin] PATH_INFO: `/v3/users/20f10c667048482ebfaee906ae949ee2` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:02.187090 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fe47b-fb26-40c7-9c48-cd644893e747 None admin] RBAC: Authorizing `identity:get_user(user_id=20f10c667048482ebfaee906ae949ee2)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:02.188580 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fe47b-fb26-40c7-9c48-cd644893e747 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:02.190114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 588/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:45:02 2022] GET /identity/v3/users/20f10c667048482ebfaee906ae949ee2 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:02.196391 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1d04e-1cc9-4d7c-bce4-5b2a63d3d36f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:02.328822 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1d04e-1cc9-4d7c-bce4-5b2a63d3d36f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:02.365238 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e76ba-6786-41a9-880c-19ea4f0fdbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:02.365848 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e76ba-6786-41a9-880c-19ea4f0fdbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:02.366088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e76ba-6786-41a9-880c-19ea4f0fdbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:02.366354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e76ba-6786-41a9-880c-19ea4f0fdbc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:02.432866 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:02.436016 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e76ba-6786-41a9-880c-19ea4f0fdbc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:02.437915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e76ba-6786-41a9-880c-19ea4f0fdbc7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:02.540841 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 571/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:45:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:45:02.547152 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fe47b-fb26-40c7-9c48-cd644893e747 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:02.666618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fe47b-fb26-40c7-9c48-cd644893e747 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:02.703510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0fef0-734f-4b40-a199-e3a41ef364ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:02.704152 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0fef0-734f-4b40-a199-e3a41ef364ca None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:02.704419 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0fef0-734f-4b40-a199-e3a41ef364ca None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:02.704681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0fef0-734f-4b40-a199-e3a41ef364ca None admin] PATH_INFO: `/v3/projects/fa6414fbea4044ddaa4f9484f1162b9a` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:02.705895 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0fef0-734f-4b40-a199-e3a41ef364ca None admin] RBAC: Authorizing `identity:get_project(project_id=fa6414fbea4044ddaa4f9484f1162b9a)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:02.707303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0fef0-734f-4b40-a199-e3a41ef364ca None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:02.708948 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 589/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:45:02 2022] GET /identity/v3/projects/fa6414fbea4044ddaa4f9484f1162b9a => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:02.719053 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e76ba-6786-41a9-880c-19ea4f0fdbc7 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:02.822831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:02.826466 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e76ba-6786-41a9-880c-19ea4f0fdbc7 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:02.863331 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0518d3-0c2f-4e27-ab46-9fa2e76badd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:02.863915 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0518d3-0c2f-4e27-ab46-9fa2e76badd9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:02.864213 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0518d3-0c2f-4e27-ab46-9fa2e76badd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:02.864453 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0518d3-0c2f-4e27-ab46-9fa2e76badd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:02.865180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0518d3-0c2f-4e27-ab46-9fa2e76badd9 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=fa6414fbea4044ddaa4f9484f1162b9a, user.id=20f10c667048482ebfaee906ae949ee2) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:02.865483 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0518d3-0c2f-4e27-ab46-9fa2e76badd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:02.866896 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0518d3-0c2f-4e27-ab46-9fa2e76badd9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:02.872690 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 572/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:45:02 2022] GET /identity/v3/role_assignments?user.id=20f10c667048482ebfaee906ae949ee2&scope.project.id=fa6414fbea4044ddaa4f9484f1162b9a&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:05.014205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d4f17-4a06-410a-b055-9a6a4f3750c6 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:05.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d4f17-4a06-410a-b055-9a6a4f3750c6 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:05.015044 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d4f17-4a06-410a-b055-9a6a4f3750c6 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:05.017284 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 590/1162] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:45:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:45:05.023544 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056c9b1-c02b-403d-b468-be21528d1335 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:05.024236 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056c9b1-c02b-403d-b468-be21528d1335 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:05.024655 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056c9b1-c02b-403d-b468-be21528d1335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:05.048476 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0056c9b1-c02b-403d-b468-be21528d1335 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:05.049614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0056c9b1-c02b-403d-b468-be21528d1335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:05.119574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 573/1163] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:45:05.393211 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d4f17-4a06-410a-b055-9a6a4f3750c6 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:05.435892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:05.522955 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d4f17-4a06-410a-b055-9a6a4f3750c6 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:05.561654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f546fe-353d-47f0-b581-176784ab9103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:05.562246 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f546fe-353d-47f0-b581-176784ab9103 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:05.562518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f546fe-353d-47f0-b581-176784ab9103 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:05.562787 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f546fe-353d-47f0-b581-176784ab9103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:05.634375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f546fe-353d-47f0-b581-176784ab9103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:05.635808 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f546fe-353d-47f0-b581-176784ab9103 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:05.663364 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:05.746910 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 591/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:45:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:45:05.753368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056c9b1-c02b-403d-b468-be21528d1335 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:05.859034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:05.868309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056c9b1-c02b-403d-b468-be21528d1335 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:05.906089 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02467839-b9fe-4298-938d-b6ae10606155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:05.906695 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467839-b9fe-4298-938d-b6ae10606155 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:05.906972 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467839-b9fe-4298-938d-b6ae10606155 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:05.907239 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467839-b9fe-4298-938d-b6ae10606155 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:05.914164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02467839-b9fe-4298-938d-b6ae10606155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:05.915560 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02467839-b9fe-4298-938d-b6ae10606155 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-02467839-b9fe-4298-938d-b6ae10606155 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:05.927164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:05.928408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:45:05.929512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 574/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Oct 9 00:45:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:05.934592 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f546fe-353d-47f0-b581-176784ab9103 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:06.033625 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f546fe-353d-47f0-b581-176784ab9103 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:06.059011 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:06.068501 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b35e96-6d68-4bfa-8b0b-ddd43139e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:06.069100 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b35e96-6d68-4bfa-8b0b-ddd43139e014 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:06.069372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b35e96-6d68-4bfa-8b0b-ddd43139e014 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:06.069635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b35e96-6d68-4bfa-8b0b-ddd43139e014 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:06.070258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b35e96-6d68-4bfa-8b0b-ddd43139e014 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:06.070552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b35e96-6d68-4bfa-8b0b-ddd43139e014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:06.071901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b35e96-6d68-4bfa-8b0b-ddd43139e014 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:06.079288 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 592/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Sun Oct 9 00:45:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:08.180426 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4ac0d-34cf-446d-aa9d-c4c16bf42e79 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:08.180973 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4ac0d-34cf-446d-aa9d-c4c16bf42e79 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:08.180973 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4ac0d-34cf-446d-aa9d-c4c16bf42e79 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:08.182205 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 575/1167] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:45:08.188763 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e16fa-5377-42ae-9794-6edb86ced4d6 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:08.189459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e16fa-5377-42ae-9794-6edb86ced4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:08.189685 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e16fa-5377-42ae-9794-6edb86ced4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:08.210699 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-ef6e16fa-5377-42ae-9794-6edb86ced4d6 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:08.211891 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-ef6e16fa-5377-42ae-9794-6edb86ced4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:08.287853 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 593/1168] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:45:08.573256 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4ac0d-34cf-446d-aa9d-c4c16bf42e79 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:08.697670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4ac0d-34cf-446d-aa9d-c4c16bf42e79 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:08.732359 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e47fee-483b-46f9-9867-f83f8c37838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:08.732981 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e47fee-483b-46f9-9867-f83f8c37838e None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:08.733249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e47fee-483b-46f9-9867-f83f8c37838e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:08.733514 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e47fee-483b-46f9-9867-f83f8c37838e None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:08.734159 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e47fee-483b-46f9-9867-f83f8c37838e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:08.735515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e47fee-483b-46f9-9867-f83f8c37838e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:08.754444 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 576/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Sun Oct 9 00:45:08 2022] POST /identity/v3/domains => generated 267 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:45:10.913333 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a4b3-f4f0-4498-a0cf-02f42a60389d None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:10.914178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a4b3-f4f0-4498-a0cf-02f42a60389d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:10.914178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a4b3-f4f0-4498-a0cf-02f42a60389d None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:10.916334 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 594/1170] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:45:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:45:10.925216 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbd1c9-5075-4c2d-838f-acd6d46bd6e3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:10.925719 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbd1c9-5075-4c2d-838f-acd6d46bd6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:10.925810 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbd1c9-5075-4c2d-838f-acd6d46bd6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:10.945169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d0fbd1c9-5075-4c2d-838f-acd6d46bd6e3 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:10.946337 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d0fbd1c9-5075-4c2d-838f-acd6d46bd6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:10.954108 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:11.016597 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 577/1171] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:45:11.281822 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a4b3-f4f0-4498-a0cf-02f42a60389d None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:11.395750 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a4b3-f4f0-4498-a0cf-02f42a60389d None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:11.419568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:11.432014 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fa4ae-6ca7-4f2d-871a-4bbd3da83841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:11.432669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa4ae-6ca7-4f2d-871a-4bbd3da83841 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:11.432943 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa4ae-6ca7-4f2d-871a-4bbd3da83841 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:11.433209 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fa4ae-6ca7-4f2d-871a-4bbd3da83841 None admin] PATH_INFO: `/v3/domains/5097ba67ab484019aeacae4a7b175c8b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:11.443645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fa4ae-6ca7-4f2d-871a-4bbd3da83841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5097ba67ab484019aeacae4a7b175c8b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:11.445106 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fa4ae-6ca7-4f2d-871a-4bbd3da83841 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:11.446679 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 595/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Sun Oct 9 00:45:11 2022] GET /identity/v3/domains/5097ba67ab484019aeacae4a7b175c8b => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:11.453467 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbd1c9-5075-4c2d-838f-acd6d46bd6e3 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:11.561333 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbd1c9-5075-4c2d-838f-acd6d46bd6e3 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:11.598232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72528a63-6b9d-489d-8306-ec60e729add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:11.598846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528a63-6b9d-489d-8306-ec60e729add4 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:11.599123 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528a63-6b9d-489d-8306-ec60e729add4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:11.599395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528a63-6b9d-489d-8306-ec60e729add4 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:11.600032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72528a63-6b9d-489d-8306-ec60e729add4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:11.601511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72528a63-6b9d-489d-8306-ec60e729add4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:11.620779 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:11.635514 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 578/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:45:11 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:45:13.782487 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1351-91a2-4184-bca6-7b52737ade2e None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:13.783374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1351-91a2-4184-bca6-7b52737ade2e None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:13.783374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1351-91a2-4184-bca6-7b52737ade2e None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:13.785530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 596/1174] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:45:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:45:13.791027 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08888-5a8a-4f6d-8cc4-28e7610fe0e3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:13.791479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08888-5a8a-4f6d-8cc4-28e7610fe0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:13.791568 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc08888-5a8a-4f6d-8cc4-28e7610fe0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:13.812073 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-abc08888-5a8a-4f6d-8cc4-28e7610fe0e3 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:13.813255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-abc08888-5a8a-4f6d-8cc4-28e7610fe0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:13.887714 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 579/1175] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:45:14.154059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab1351-91a2-4184-bca6-7b52737ade2e None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:14.261683 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab1351-91a2-4184-bca6-7b52737ade2e None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:14.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6c03f-2457-42e1-9139-bcea2157210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:14.295468 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6c03f-2457-42e1-9139-bcea2157210e None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:14.295732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6c03f-2457-42e1-9139-bcea2157210e None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:14.295992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6c03f-2457-42e1-9139-bcea2157210e None admin] PATH_INFO: `/v3/domains/5097ba67ab484019aeacae4a7b175c8b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:14.297238 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6c03f-2457-42e1-9139-bcea2157210e None admin] RBAC: Authorizing `identity:get_domain(domain_id=5097ba67ab484019aeacae4a7b175c8b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:14.298648 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6c03f-2457-42e1-9139-bcea2157210e None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:14.300283 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 597/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Sun Oct 9 00:45:14 2022] GET /identity/v3/domains/5097ba67ab484019aeacae4a7b175c8b => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:14.306951 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc08888-5a8a-4f6d-8cc4-28e7610fe0e3 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:14.416434 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc08888-5a8a-4f6d-8cc4-28e7610fe0e3 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:14.446745 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:14.462063 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757837d7-9144-4a72-9ad6-f6e270745f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:14.462672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757837d7-9144-4a72-9ad6-f6e270745f33 None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:14.462948 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757837d7-9144-4a72-9ad6-f6e270745f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:14.463219 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757837d7-9144-4a72-9ad6-f6e270745f33 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:14.463866 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757837d7-9144-4a72-9ad6-f6e270745f33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:14.465338 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757837d7-9144-4a72-9ad6-f6e270745f33 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:14.489052 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 580/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:45:14 2022] POST /identity/v3/users => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:45:16.671915 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22961-7270-42fd-97b8-db193a02f12c None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:16.672869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22961-7270-42fd-97b8-db193a02f12c None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:16.672869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22961-7270-42fd-97b8-db193a02f12c None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:16.675377 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 598/1178] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:45:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:45:16.680724 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c628b1d-4066-4f74-a699-9a7243ee4af3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:16.681155 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c628b1d-4066-4f74-a699-9a7243ee4af3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:16.681263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c628b1d-4066-4f74-a699-9a7243ee4af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:16.701033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1c628b1d-4066-4f74-a699-9a7243ee4af3 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:16.702212 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1c628b1d-4066-4f74-a699-9a7243ee4af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:16.771502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 581/1179] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:45:17.046406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a22961-7270-42fd-97b8-db193a02f12c None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:17.110619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:17.164600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a22961-7270-42fd-97b8-db193a02f12c None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:17.199088 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663382c-bf1c-48e4-959e-4150962ab6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:17.199697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663382c-bf1c-48e4-959e-4150962ab6cf None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:17.199964 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663382c-bf1c-48e4-959e-4150962ab6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:17.200264 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663382c-bf1c-48e4-959e-4150962ab6cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:17.211314 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663382c-bf1c-48e4-959e-4150962ab6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-b663382c-bf1c-48e4-959e-4150962ab6cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:45:17.216023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:17.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:45:17.218227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:45:17.220231 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 599/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:17.223396 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c628b1d-4066-4f74-a699-9a7243ee4af3 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:17.323956 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c628b1d-4066-4f74-a699-9a7243ee4af3 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:17.334540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:17.371030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e543f-f5a8-4c87-8103-240ba469e1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:17.371631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e543f-f5a8-4c87-8103-240ba469e1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:17.371905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e543f-f5a8-4c87-8103-240ba469e1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:17.372207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e543f-f5a8-4c87-8103-240ba469e1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:17.372863 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e543f-f5a8-4c87-8103-240ba469e1f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:17.373159 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e543f-f5a8-4c87-8103-240ba469e1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:17.374547 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e543f-f5a8-4c87-8103-240ba469e1f7 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:17.383154 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 582/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:17.389240 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663382c-bf1c-48e4-959e-4150962ab6cf None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:17.493467 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663382c-bf1c-48e4-959e-4150962ab6cf None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:17.503776 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:17.529383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5098840-6fd9-479d-ba6f-a08ca8711c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:17.530068 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5098840-6fd9-479d-ba6f-a08ca8711c74 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:17.530251 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5098840-6fd9-479d-ba6f-a08ca8711c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:17.530531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5098840-6fd9-479d-ba6f-a08ca8711c74 None admin] PATH_INFO: `/v3/users/491380119c9a46b6b293c0433943b19e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:17.544276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5098840-6fd9-479d-ba6f-a08ca8711c74 None admin] RBAC: Authorizing `identity:get_user(user_id=491380119c9a46b6b293c0433943b19e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:17.545718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5098840-6fd9-479d-ba6f-a08ca8711c74 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:17.547306 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 600/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:45:17 2022] GET /identity/v3/users/491380119c9a46b6b293c0433943b19e => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:17.553521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e543f-f5a8-4c87-8103-240ba469e1f7 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:17.671673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e543f-f5a8-4c87-8103-240ba469e1f7 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:17.706114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c3ea5-2646-446c-82d0-9377f9e08097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:17.706947 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c3ea5-2646-446c-82d0-9377f9e08097 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:17.707080 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c3ea5-2646-446c-82d0-9377f9e08097 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:17.707322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c3ea5-2646-446c-82d0-9377f9e08097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:17.752229 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:17.781132 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c3ea5-2646-446c-82d0-9377f9e08097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:17.782599 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c3ea5-2646-446c-82d0-9377f9e08097 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:17.886137 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 583/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:45:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:45:17.892531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5098840-6fd9-479d-ba6f-a08ca8711c74 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:18.020256 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5098840-6fd9-479d-ba6f-a08ca8711c74 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:18.058561 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97c6c5-07f8-426a-9c11-1fdfeb9601e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:18.059173 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97c6c5-07f8-426a-9c11-1fdfeb9601e0 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:18.059442 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97c6c5-07f8-426a-9c11-1fdfeb9601e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:18.059708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97c6c5-07f8-426a-9c11-1fdfeb9601e0 None admin] PATH_INFO: `/v3/projects/cedf1ea9ebe3400d94e427c8c28d93ec` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:18.060963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97c6c5-07f8-426a-9c11-1fdfeb9601e0 None admin] RBAC: Authorizing `identity:get_project(project_id=cedf1ea9ebe3400d94e427c8c28d93ec)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:18.062390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97c6c5-07f8-426a-9c11-1fdfeb9601e0 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:18.064013 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 601/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:45:17 2022] GET /identity/v3/projects/cedf1ea9ebe3400d94e427c8c28d93ec => generated 361 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:18.074456 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c3ea5-2646-446c-82d0-9377f9e08097 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:18.155464 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:18.194949 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c3ea5-2646-446c-82d0-9377f9e08097 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:18.230540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ec373-ae0e-430a-b4dd-013ddc5fbe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:18.231129 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ec373-ae0e-430a-b4dd-013ddc5fbe23 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:18.231401 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ec373-ae0e-430a-b4dd-013ddc5fbe23 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:18.231666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ec373-ae0e-430a-b4dd-013ddc5fbe23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:18.232406 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ec373-ae0e-430a-b4dd-013ddc5fbe23 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=cedf1ea9ebe3400d94e427c8c28d93ec, user.id=491380119c9a46b6b293c0433943b19e) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:18.232711 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ec373-ae0e-430a-b4dd-013ddc5fbe23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:18.234133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ec373-ae0e-430a-b4dd-013ddc5fbe23 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:18.239814 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 584/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:45:18 2022] GET /identity/v3/role_assignments?user.id=491380119c9a46b6b293c0433943b19e&scope.project.id=cedf1ea9ebe3400d94e427c8c28d93ec&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:20.357371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534e475-981f-4a97-9cb0-404010d9c097 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:20.358225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534e475-981f-4a97-9cb0-404010d9c097 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:20.358225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534e475-981f-4a97-9cb0-404010d9c097 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:20.360503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 602/1186] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:45:20.366238 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fbf43-dd6c-4ac9-9e5d-c87edffba6ad None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:20.366670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fbf43-dd6c-4ac9-9e5d-c87edffba6ad None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:20.366781 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fbf43-dd6c-4ac9-9e5d-c87edffba6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:20.386219 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-252fbf43-dd6c-4ac9-9e5d-c87edffba6ad None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:20.387397 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-252fbf43-dd6c-4ac9-9e5d-c87edffba6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:20.458948 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 585/1187] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:45:20.732398 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534e475-981f-4a97-9cb0-404010d9c097 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:20.779942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:20.851441 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534e475-981f-4a97-9cb0-404010d9c097 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:20.888304 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75666b-b8cc-4548-80f6-9944b19325ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:20.888920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75666b-b8cc-4548-80f6-9944b19325ce None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:20.889196 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75666b-b8cc-4548-80f6-9944b19325ce None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:20.889465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75666b-b8cc-4548-80f6-9944b19325ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:20.899971 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75666b-b8cc-4548-80f6-9944b19325ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-0d75666b-b8cc-4548-80f6-9944b19325ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:45:20.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:20.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:45:20.907204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 603/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:20.912285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fbf43-dd6c-4ac9-9e5d-c87edffba6ad None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:20.983048 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:21.031226 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fbf43-dd6c-4ac9-9e5d-c87edffba6ad None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:21.068487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d7189-a175-49dc-a7d6-8698a475f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:21.069075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7189-a175-49dc-a7d6-8698a475f4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:21.069342 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7189-a175-49dc-a7d6-8698a475f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:21.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7189-a175-49dc-a7d6-8698a475f4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:21.070249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d7189-a175-49dc-a7d6-8698a475f4f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:21.070536 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d7189-a175-49dc-a7d6-8698a475f4f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:21.071903 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d7189-a175-49dc-a7d6-8698a475f4f8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:21.079941 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 586/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:21.086202 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75666b-b8cc-4548-80f6-9944b19325ce None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:21.198617 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:21.205401 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75666b-b8cc-4548-80f6-9944b19325ce None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:21.243831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326876a6-dfc7-451d-9c0c-a9e3d361d37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:21.244426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326876a6-dfc7-451d-9c0c-a9e3d361d37d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:21.244695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326876a6-dfc7-451d-9c0c-a9e3d361d37d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:21.244960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326876a6-dfc7-451d-9c0c-a9e3d361d37d None admin] PATH_INFO: `/v3/users/491380119c9a46b6b293c0433943b19e` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:21.246096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326876a6-dfc7-451d-9c0c-a9e3d361d37d None admin] RBAC: Authorizing `identity:get_user(user_id=491380119c9a46b6b293c0433943b19e)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:21.247520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326876a6-dfc7-451d-9c0c-a9e3d361d37d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:21.249224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 604/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:45:21 2022] GET /identity/v3/users/491380119c9a46b6b293c0433943b19e => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:21.256165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d7189-a175-49dc-a7d6-8698a475f4f8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:21.390116 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d7189-a175-49dc-a7d6-8698a475f4f8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:21.418468 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:21.432584 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dbfe2-341c-47ea-bdf3-cb0590d41392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:21.433461 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dbfe2-341c-47ea-bdf3-cb0590d41392 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:21.433802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dbfe2-341c-47ea-bdf3-cb0590d41392 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:21.434151 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dbfe2-341c-47ea-bdf3-cb0590d41392 None admin] PATH_INFO: `/v3/projects/cedf1ea9ebe3400d94e427c8c28d93ec` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:21.435885 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dbfe2-341c-47ea-bdf3-cb0590d41392 None admin] RBAC: Authorizing `identity:get_project(project_id=cedf1ea9ebe3400d94e427c8c28d93ec)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:21.438136 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dbfe2-341c-47ea-bdf3-cb0590d41392 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:21.440682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 587/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:45:21 2022] GET /identity/v3/projects/cedf1ea9ebe3400d94e427c8c28d93ec => generated 361 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:21.449669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326876a6-dfc7-451d-9c0c-a9e3d361d37d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:21.554231 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326876a6-dfc7-451d-9c0c-a9e3d361d37d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:21.599620 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a809f7-1a26-410a-a035-ac7008287ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:21.600320 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a809f7-1a26-410a-a035-ac7008287ae6 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:21.600589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a809f7-1a26-410a-a035-ac7008287ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:21.600876 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a809f7-1a26-410a-a035-ac7008287ae6 None admin] PATH_INFO: `/v3/projects/cedf1ea9ebe3400d94e427c8c28d93ec/users/491380119c9a46b6b293c0433943b19e/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:21.603027 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a809f7-1a26-410a-a035-ac7008287ae6 None admin] RBAC: Authorizing `identity:create_grant(project_id=cedf1ea9ebe3400d94e427c8c28d93ec, user_id=491380119c9a46b6b293c0433943b19e, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:21.604461 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a809f7-1a26-410a-a035-ac7008287ae6 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:21.620674 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 605/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:45:21 2022] PUT /identity/v3/projects/cedf1ea9ebe3400d94e427c8c28d93ec/users/491380119c9a46b6b293c0433943b19e/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:45:23.705007 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e1372-de7e-41f7-b594-954bc20a0445 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:23.705874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e1372-de7e-41f7-b594-954bc20a0445 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:23.705874 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e1372-de7e-41f7-b594-954bc20a0445 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:23.708484 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 588/1193] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:45:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:45:23.713932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd224a-1722-4328-9b5e-aa93a32d7f15 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:23.714356 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd224a-1722-4328-9b5e-aa93a32d7f15 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:23.714465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd224a-1722-4328-9b5e-aa93a32d7f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:23.733274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-18bd224a-1722-4328-9b5e-aa93a32d7f15 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:23.734434 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-18bd224a-1722-4328-9b5e-aa93a32d7f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:23.751884 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:23.810986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 606/1194] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:45:24.075893 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e1372-de7e-41f7-b594-954bc20a0445 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:24.195981 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e1372-de7e-41f7-b594-954bc20a0445 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:24.236940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c384cc7-a9e0-445b-abbd-f7eaf1745332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:24.237746 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c384cc7-a9e0-445b-abbd-f7eaf1745332 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:24.238193 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c384cc7-a9e0-445b-abbd-f7eaf1745332 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:24.238474 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c384cc7-a9e0-445b-abbd-f7eaf1745332 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:24.249235 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c384cc7-a9e0-445b-abbd-f7eaf1745332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-5c384cc7-a9e0-445b-abbd-f7eaf1745332 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:45:24.254253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:24.255650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:45:24.256729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 589/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:45:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:24.262733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd224a-1722-4328-9b5e-aa93a32d7f15 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:24.369187 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd224a-1722-4328-9b5e-aa93a32d7f15 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:24.405805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314763db-e570-4661-b10d-888446a8352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:24.406398 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314763db-e570-4661-b10d-888446a8352f None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:24.406667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314763db-e570-4661-b10d-888446a8352f None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:24.406935 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314763db-e570-4661-b10d-888446a8352f None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:24.407587 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314763db-e570-4661-b10d-888446a8352f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:24.407880 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314763db-e570-4661-b10d-888446a8352f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:24.409431 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314763db-e570-4661-b10d-888446a8352f None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:24.418151 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 607/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:45:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:24.428007 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c384cc7-a9e0-445b-abbd-f7eaf1745332 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:24.493704 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:24.540451 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c384cc7-a9e0-445b-abbd-f7eaf1745332 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:24.578898 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50249f-1b13-44f2-9e23-346fd5f44805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:24.579509 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50249f-1b13-44f2-9e23-346fd5f44805 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:24.579780 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50249f-1b13-44f2-9e23-346fd5f44805 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:24.580069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50249f-1b13-44f2-9e23-346fd5f44805 None admin] PATH_INFO: `/v3/users/491380119c9a46b6b293c0433943b19e` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:24.581194 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50249f-1b13-44f2-9e23-346fd5f44805 None admin] RBAC: Authorizing `identity:get_user(user_id=491380119c9a46b6b293c0433943b19e)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:24.582615 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50249f-1b13-44f2-9e23-346fd5f44805 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:24.584224 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 590/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Sun Oct 9 00:45:24 2022] GET /identity/v3/users/491380119c9a46b6b293c0433943b19e => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:24.590897 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314763db-e570-4661-b10d-888446a8352f None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:24.614407 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:24.700462 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314763db-e570-4661-b10d-888446a8352f None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:24.739281 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e9ad1-2d29-42c0-ace8-67ae45499704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:24.739906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e9ad1-2d29-42c0-ace8-67ae45499704 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:24.740403 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e9ad1-2d29-42c0-ace8-67ae45499704 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:24.740778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e9ad1-2d29-42c0-ace8-67ae45499704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:24.817847 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e9ad1-2d29-42c0-ace8-67ae45499704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:24.819286 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e9ad1-2d29-42c0-ace8-67ae45499704 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:24.836381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:24.928024 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 608/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:45:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:45:24.934606 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50249f-1b13-44f2-9e23-346fd5f44805 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:25.043144 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50249f-1b13-44f2-9e23-346fd5f44805 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:25.067017 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:25.078964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8eda0-215a-4679-9dca-44cef651bb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:25.079588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8eda0-215a-4679-9dca-44cef651bb0f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:25.079860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8eda0-215a-4679-9dca-44cef651bb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:25.080147 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8eda0-215a-4679-9dca-44cef651bb0f None admin] PATH_INFO: `/v3/projects/cedf1ea9ebe3400d94e427c8c28d93ec` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:25.081567 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8eda0-215a-4679-9dca-44cef651bb0f None admin] RBAC: Authorizing `identity:get_project(project_id=cedf1ea9ebe3400d94e427c8c28d93ec)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:25.083008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8eda0-215a-4679-9dca-44cef651bb0f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:25.084657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 591/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Sun Oct 9 00:45:24 2022] GET /identity/v3/projects/cedf1ea9ebe3400d94e427c8c28d93ec => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:25.091303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e9ad1-2d29-42c0-ace8-67ae45499704 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:25.193423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e9ad1-2d29-42c0-ace8-67ae45499704 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:25.209939 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:25.235129 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0ac6d-0f7d-46a1-8e3f-c19ea3d8e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:25.235731 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ac6d-0f7d-46a1-8e3f-c19ea3d8e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:25.236003 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ac6d-0f7d-46a1-8e3f-c19ea3d8e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:25.236304 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ac6d-0f7d-46a1-8e3f-c19ea3d8e4f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:25.237009 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0ac6d-0f7d-46a1-8e3f-c19ea3d8e4f4 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=cedf1ea9ebe3400d94e427c8c28d93ec, user.id=491380119c9a46b6b293c0433943b19e) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:25.237443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0ac6d-0f7d-46a1-8e3f-c19ea3d8e4f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:25.238717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0ac6d-0f7d-46a1-8e3f-c19ea3d8e4f4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:25.245089 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 609/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:45:25 2022] GET /identity/v3/role_assignments?user.id=491380119c9a46b6b293c0433943b19e&scope.project.id=cedf1ea9ebe3400d94e427c8c28d93ec&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:35.074733 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=4 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:35.242044 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=10 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:20.847515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026b7fb-e42c-43fc-b54c-da0f34ca7eed None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:20.848142 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026b7fb-e42c-43fc-b54c-da0f34ca7eed None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:20.848142 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026b7fb-e42c-43fc-b54c-da0f34ca7eed None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:20.849718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 592/1201] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:20.855154 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4370d-2e69-4d52-bc6d-3985ac804422 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:20.855648 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4370d-2e69-4d52-bc6d-3985ac804422 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:20.855736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4370d-2e69-4d52-bc6d-3985ac804422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:20.875324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-10e4370d-2e69-4d52-bc6d-3985ac804422 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:20.876873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-10e4370d-2e69-4d52-bc6d-3985ac804422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:20.968322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 610/1202] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:21.243146 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026b7fb-e42c-43fc-b54c-da0f34ca7eed None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:21.378547 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026b7fb-e42c-43fc-b54c-da0f34ca7eed None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:21.426314 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d469e-77fa-40c4-beaa-58b65d2381c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:21.427105 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d469e-77fa-40c4-beaa-58b65d2381c3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:21.427412 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d469e-77fa-40c4-beaa-58b65d2381c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:21.427686 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d469e-77fa-40c4-beaa-58b65d2381c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:21.439045 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d469e-77fa-40c4-beaa-58b65d2381c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:21.441023 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d469e-77fa-40c4-beaa-58b65d2381c3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-457d469e-77fa-40c4-beaa-58b65d2381c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:21.458419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:21.460694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:21.462061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:21.462061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:21.462061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:21.462061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 593/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:21.466163 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4370d-2e69-4d52-bc6d-3985ac804422 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:21.612655 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4370d-2e69-4d52-bc6d-3985ac804422 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:21.655543 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:21.670414 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9434d1-a1c2-4189-ba2d-a2de45ffee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:21.673391 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9434d1-a1c2-4189-ba2d-a2de45ffee8a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:21.673743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9434d1-a1c2-4189-ba2d-a2de45ffee8a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:21.674043 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9434d1-a1c2-4189-ba2d-a2de45ffee8a None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:21.674800 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9434d1-a1c2-4189-ba2d-a2de45ffee8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:21.675125 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9434d1-a1c2-4189-ba2d-a2de45ffee8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:21.676713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9434d1-a1c2-4189-ba2d-a2de45ffee8a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:21.692370 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 611/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:21.697786 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d469e-77fa-40c4-beaa-58b65d2381c3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:21.762329 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:21.831102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d469e-77fa-40c4-beaa-58b65d2381c3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:21.881014 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179008b-5ee8-4a17-815b-c915ac32630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:21.881657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179008b-5ee8-4a17-815b-c915ac32630a None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:21.881775 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179008b-5ee8-4a17-815b-c915ac32630a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:21.881956 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179008b-5ee8-4a17-815b-c915ac32630a None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:21.882832 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179008b-5ee8-4a17-815b-c915ac32630a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:21.884220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179008b-5ee8-4a17-815b-c915ac32630a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:21.917609 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 594/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Sun Oct 9 00:46:21 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:46:24.262185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9973-b0d4-464f-bfa0-95e7508e5434 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:24.262185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9973-b0d4-464f-bfa0-95e7508e5434 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:24.262185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9973-b0d4-464f-bfa0-95e7508e5434 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:24.262185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 612/1206] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:24.267729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e52c0-f4c4-4849-b993-d3abe426b5df None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:24.268328 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e52c0-f4c4-4849-b993-d3abe426b5df None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:24.268625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e52c0-f4c4-4849-b993-d3abe426b5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:24.287539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-ac6e52c0-f4c4-4849-b993-d3abe426b5df None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:24.288747 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ac6e52c0-f4c4-4849-b993-d3abe426b5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:24.366264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 595/1207] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:24.642975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e9973-b0d4-464f-bfa0-95e7508e5434 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:24.775671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e9973-b0d4-464f-bfa0-95e7508e5434 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:24.821897 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6a1a7-866a-481e-b2da-76dcc861f1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:24.822580 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6a1a7-866a-481e-b2da-76dcc861f1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:24.822877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6a1a7-866a-481e-b2da-76dcc861f1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:24.823167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6a1a7-866a-481e-b2da-76dcc861f1d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:24.837193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6a1a7-866a-481e-b2da-76dcc861f1d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-55b6a1a7-866a-481e-b2da-76dcc861f1d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:46:24.842054 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:24.843450 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:24.844649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 613/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:46:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:24.852739 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e52c0-f4c4-4849-b993-d3abe426b5df None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:24.907801 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:24.989860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e52c0-f4c4-4849-b993-d3abe426b5df None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:25.030168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e60988-1ff2-4663-a74a-6f87f0c9aa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:25.030780 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e60988-1ff2-4663-a74a-6f87f0c9aa60 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:25.031068 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e60988-1ff2-4663-a74a-6f87f0c9aa60 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:25.031328 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e60988-1ff2-4663-a74a-6f87f0c9aa60 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:25.031978 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e60988-1ff2-4663-a74a-6f87f0c9aa60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:25.032313 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e60988-1ff2-4663-a74a-6f87f0c9aa60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:25.034004 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e60988-1ff2-4663-a74a-6f87f0c9aa60 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:25.047643 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 596/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:46:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:25.050132 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6a1a7-866a-481e-b2da-76dcc861f1d2 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:25.110676 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:25.168738 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6a1a7-866a-481e-b2da-76dcc861f1d2 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:25.205305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f09b26-c4b1-44c0-8560-2c2325a6103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:25.207088 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f09b26-c4b1-44c0-8560-2c2325a6103a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:25.207346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f09b26-c4b1-44c0-8560-2c2325a6103a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:25.207589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f09b26-c4b1-44c0-8560-2c2325a6103a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:25.225408 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f09b26-c4b1-44c0-8560-2c2325a6103a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:25.226869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f09b26-c4b1-44c0-8560-2c2325a6103a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-b2f09b26-c4b1-44c0-8560-2c2325a6103a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:25.241664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:25.242697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:25.243641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:25.243641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:25.243641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:25.243641 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 614/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:46:25.250119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e60988-1ff2-4663-a74a-6f87f0c9aa60 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:25.378144 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:25.382890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e60988-1ff2-4663-a74a-6f87f0c9aa60 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:25.431022 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22544677-472d-44f4-9b06-7490234daf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:25.431554 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22544677-472d-44f4-9b06-7490234daf1b None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:25.431854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22544677-472d-44f4-9b06-7490234daf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:25.432154 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22544677-472d-44f4-9b06-7490234daf1b None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:25.432931 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22544677-472d-44f4-9b06-7490234daf1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:25.433248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22544677-472d-44f4-9b06-7490234daf1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:25.434568 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22544677-472d-44f4-9b06-7490234daf1b None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:25.448579 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 597/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:25.454640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f09b26-c4b1-44c0-8560-2c2325a6103a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:25.582337 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f09b26-c4b1-44c0-8560-2c2325a6103a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:25.583937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:25.618718 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066bc3e-cb3d-48de-9dfb-f42121a557c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:25.619429 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066bc3e-cb3d-48de-9dfb-f42121a557c0 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:25.619702 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066bc3e-cb3d-48de-9dfb-f42121a557c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:25.619967 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066bc3e-cb3d-48de-9dfb-f42121a557c0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:25.629240 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066bc3e-cb3d-48de-9dfb-f42121a557c0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:25.630743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066bc3e-cb3d-48de-9dfb-f42121a557c0 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-b066bc3e-cb3d-48de-9dfb-f42121a557c0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:46:25.645459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:25.646719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:25.652908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:25.652908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:25.652908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:46:25.652908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:46:25.652908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:46:25.652908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:46:25.652908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:46:25.652908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:46:25.652908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:25.652908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:25.652908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 615/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:25.653556 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22544677-472d-44f4-9b06-7490234daf1b None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:25.765149 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22544677-472d-44f4-9b06-7490234daf1b None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:25.803828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008e14-3b19-4bdf-8171-f4dce7222607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:25.804512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008e14-3b19-4bdf-8171-f4dce7222607 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:25.804786 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008e14-3b19-4bdf-8171-f4dce7222607 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:25.805050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008e14-3b19-4bdf-8171-f4dce7222607 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:25.805951 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac008e14-3b19-4bdf-8171-f4dce7222607 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:25.807857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac008e14-3b19-4bdf-8171-f4dce7222607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:25.807857 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac008e14-3b19-4bdf-8171-f4dce7222607 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:25.829562 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 598/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Oct 9 00:46:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:25.836790 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066bc3e-cb3d-48de-9dfb-f42121a557c0 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:25.948018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066bc3e-cb3d-48de-9dfb-f42121a557c0 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:25.984216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a868b-881d-4d19-82a9-2ae83ab4c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:25.984880 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a868b-881d-4d19-82a9-2ae83ab4c0fe None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:25.985167 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a868b-881d-4d19-82a9-2ae83ab4c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:25.985449 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a868b-881d-4d19-82a9-2ae83ab4c0fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:26.019684 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:26.062048 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a868b-881d-4d19-82a9-2ae83ab4c0fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:26.063824 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a868b-881d-4d19-82a9-2ae83ab4c0fe None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:26.177447 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 616/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:46:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:46:26.179101 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008e14-3b19-4bdf-8171-f4dce7222607 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:26.199522 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:26.293084 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008e14-3b19-4bdf-8171-f4dce7222607 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:26.328151 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be66980-46d8-4cb8-901d-4559cd5b85cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:26.328845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be66980-46d8-4cb8-901d-4559cd5b85cd None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:26.329180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be66980-46d8-4cb8-901d-4559cd5b85cd None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:26.329398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be66980-46d8-4cb8-901d-4559cd5b85cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:26.340730 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be66980-46d8-4cb8-901d-4559cd5b85cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:26.342412 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be66980-46d8-4cb8-901d-4559cd5b85cd None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-4be66980-46d8-4cb8-901d-4559cd5b85cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:26.357946 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:26.359057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:26.360020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:26.360020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:26.360020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:26.360020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 599/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:26.367363 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a868b-881d-4d19-82a9-2ae83ab4c0fe None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:26.436685 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:26.488172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a868b-881d-4d19-82a9-2ae83ab4c0fe None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:26.532983 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89f4d1-6b0d-4364-b29d-74b1f37e2849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:26.534032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f4d1-6b0d-4364-b29d-74b1f37e2849 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:26.534659 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f4d1-6b0d-4364-b29d-74b1f37e2849 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:26.535133 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f4d1-6b0d-4364-b29d-74b1f37e2849 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:26.535968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89f4d1-6b0d-4364-b29d-74b1f37e2849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:26.536445 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89f4d1-6b0d-4364-b29d-74b1f37e2849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:26.537940 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89f4d1-6b0d-4364-b29d-74b1f37e2849 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:26.551807 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 617/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:26.557852 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be66980-46d8-4cb8-901d-4559cd5b85cd None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:26.637102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:26.676100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be66980-46d8-4cb8-901d-4559cd5b85cd None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:26.719025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bdca7-6a3a-4fa9-999a-a46d27a64807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:26.719793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bdca7-6a3a-4fa9-999a-a46d27a64807 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:26.720201 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bdca7-6a3a-4fa9-999a-a46d27a64807 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:26.720506 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bdca7-6a3a-4fa9-999a-a46d27a64807 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:26.729263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bdca7-6a3a-4fa9-999a-a46d27a64807 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:26.730932 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bdca7-6a3a-4fa9-999a-a46d27a64807 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-374bdca7-6a3a-4fa9-999a-a46d27a64807 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:46:26.743588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:26.744753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:26.746268 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:46:26.746268 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:46:26.746268 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:46:26.746268 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:46:26.746268 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:46:26.746268 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:46:26.746268 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:26.746268 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:26.746268 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 600/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:26.751129 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89f4d1-6b0d-4364-b29d-74b1f37e2849 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:26.877327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89f4d1-6b0d-4364-b29d-74b1f37e2849 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:26.909131 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:26.927624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701d227-5241-4523-b9be-18f4eeae54eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:26.928309 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701d227-5241-4523-b9be-18f4eeae54eb None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:26.928602 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701d227-5241-4523-b9be-18f4eeae54eb None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:26.928888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701d227-5241-4523-b9be-18f4eeae54eb None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:26.929640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701d227-5241-4523-b9be-18f4eeae54eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:26.929961 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701d227-5241-4523-b9be-18f4eeae54eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:26.931939 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701d227-5241-4523-b9be-18f4eeae54eb None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:26.952118 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 618/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:46:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:26.954222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bdca7-6a3a-4fa9-999a-a46d27a64807 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:27.091067 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bdca7-6a3a-4fa9-999a-a46d27a64807 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:27.126713 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:27.134239 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f90437-4a91-48cc-af0c-cee98f07a490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:27.134918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f90437-4a91-48cc-af0c-cee98f07a490 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:27.135249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f90437-4a91-48cc-af0c-cee98f07a490 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:27.135612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f90437-4a91-48cc-af0c-cee98f07a490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:27.136360 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f90437-4a91-48cc-af0c-cee98f07a490 None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=536ebcc364834a75beefab0f2b0cc196) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:27.136662 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f90437-4a91-48cc-af0c-cee98f07a490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:27.138259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f90437-4a91-48cc-af0c-cee98f07a490 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:27.144464 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 601/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:46:26 2022] GET /identity/v3/role_assignments?user.id=536ebcc364834a75beefab0f2b0cc196&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:29.303347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd977a7-421a-4d42-886a-fa74d222306f None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:29.303974 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd977a7-421a-4d42-886a-fa74d222306f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:29.303974 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd977a7-421a-4d42-886a-fa74d222306f None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:29.306234 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 619/1220] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:46:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:29.311710 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b11aff-452e-4304-ad74-59525ea8cb09 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:29.312199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b11aff-452e-4304-ad74-59525ea8cb09 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:29.312372 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b11aff-452e-4304-ad74-59525ea8cb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:29.336580 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a2b11aff-452e-4304-ad74-59525ea8cb09 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:29.338114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a2b11aff-452e-4304-ad74-59525ea8cb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:29.410420 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 602/1221] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:46:29.697541 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd977a7-421a-4d42-886a-fa74d222306f None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:29.820233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd977a7-421a-4d42-886a-fa74d222306f None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:29.862696 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192934a-bebd-4b81-9cb2-5576f63e8dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:29.863382 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192934a-bebd-4b81-9cb2-5576f63e8dbc None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:29.863655 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192934a-bebd-4b81-9cb2-5576f63e8dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:29.863962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192934a-bebd-4b81-9cb2-5576f63e8dbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:29.880377 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192934a-bebd-4b81-9cb2-5576f63e8dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-a192934a-bebd-4b81-9cb2-5576f63e8dbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:46:29.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:29.886954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:29.887835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 620/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:46:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:46:29.895122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b11aff-452e-4304-ad74-59525ea8cb09 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:30.020252 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b11aff-452e-4304-ad74-59525ea8cb09 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:30.046391 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:30.059448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9dea8-3409-4626-a528-d49b6babe988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:30.060251 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9dea8-3409-4626-a528-d49b6babe988 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:30.060527 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9dea8-3409-4626-a528-d49b6babe988 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:30.060794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9dea8-3409-4626-a528-d49b6babe988 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:30.061588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9dea8-3409-4626-a528-d49b6babe988 None admin] RBAC: Adding query filter params (name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:30.062080 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9dea8-3409-4626-a528-d49b6babe988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:30.063688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9dea8-3409-4626-a528-d49b6babe988 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:30.073585 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 603/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:46:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:30.080534 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192934a-bebd-4b81-9cb2-5576f63e8dbc None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:30.130809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:30.193620 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192934a-bebd-4b81-9cb2-5576f63e8dbc None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:30.234109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365eef-c5e9-4f89-bed7-eac39c0804d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:30.235106 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365eef-c5e9-4f89-bed7-eac39c0804d9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:30.235384 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365eef-c5e9-4f89-bed7-eac39c0804d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:30.235653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365eef-c5e9-4f89-bed7-eac39c0804d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:30.247264 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365eef-c5e9-4f89-bed7-eac39c0804d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:30.248906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365eef-c5e9-4f89-bed7-eac39c0804d9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-a9365eef-c5e9-4f89-bed7-eac39c0804d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:30.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:30.267454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:30.268517 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:30.268517 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:30.268517 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:30.268517 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 621/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:30.273734 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9dea8-3409-4626-a528-d49b6babe988 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:30.385596 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9dea8-3409-4626-a528-d49b6babe988 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:30.427494 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7229052-7eb6-45cd-9f35-2f49c8af08ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:30.428214 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7229052-7eb6-45cd-9f35-2f49c8af08ad None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:30.428586 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7229052-7eb6-45cd-9f35-2f49c8af08ad None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:30.428956 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7229052-7eb6-45cd-9f35-2f49c8af08ad None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:30.429781 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7229052-7eb6-45cd-9f35-2f49c8af08ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:30.430197 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7229052-7eb6-45cd-9f35-2f49c8af08ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:30.431885 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7229052-7eb6-45cd-9f35-2f49c8af08ad None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:30.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 604/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:30.452725 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365eef-c5e9-4f89-bed7-eac39c0804d9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:30.569550 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:30.576996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365eef-c5e9-4f89-bed7-eac39c0804d9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:30.613898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d4025-b6e9-429c-b568-41af4ae494d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:30.614557 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d4025-b6e9-429c-b568-41af4ae494d4 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:30.614852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d4025-b6e9-429c-b568-41af4ae494d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:30.615093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d4025-b6e9-429c-b568-41af4ae494d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:30.623845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d4025-b6e9-429c-b568-41af4ae494d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:30.625401 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d4025-b6e9-429c-b568-41af4ae494d4 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-872d4025-b6e9-429c-b568-41af4ae494d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:46:30.637745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:30.639066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:30.640352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:30.640352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:30.640352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:46:30.640352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:46:30.640352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:46:30.640352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:46:30.640352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:46:30.640352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:46:30.640352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:30.640352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:30.640352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 622/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:46:30.645431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7229052-7eb6-45cd-9f35-2f49c8af08ad None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:30.695127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:30.758842 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7229052-7eb6-45cd-9f35-2f49c8af08ad None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:30.800709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fbf23-56ad-4897-8293-1d1c956bfb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:30.801370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fbf23-56ad-4897-8293-1d1c956bfb47 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:30.802374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fbf23-56ad-4897-8293-1d1c956bfb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:30.802374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fbf23-56ad-4897-8293-1d1c956bfb47 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:30.802693 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fbf23-56ad-4897-8293-1d1c956bfb47 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:30.802993 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fbf23-56ad-4897-8293-1d1c956bfb47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:30.804510 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fbf23-56ad-4897-8293-1d1c956bfb47 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:30.822930 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 605/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Oct 9 00:46:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:30.829050 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d4025-b6e9-429c-b568-41af4ae494d4 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:30.951256 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d4025-b6e9-429c-b568-41af4ae494d4 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:30.987417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809ab9d-fefd-48da-a028-1beab9fb6199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:30.988072 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809ab9d-fefd-48da-a028-1beab9fb6199 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:30.988351 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809ab9d-fefd-48da-a028-1beab9fb6199 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:30.988624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809ab9d-fefd-48da-a028-1beab9fb6199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:30.999778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809ab9d-fefd-48da-a028-1beab9fb6199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:31.001286 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809ab9d-fefd-48da-a028-1beab9fb6199 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-b809ab9d-fefd-48da-a028-1beab9fb6199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:31.018861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:31.020156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:31.021105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:31.021105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:31.021105 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:31.025343 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 623/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:46:31.026563 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fbf23-56ad-4897-8293-1d1c956bfb47 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:31.133157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fbf23-56ad-4897-8293-1d1c956bfb47 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:31.135357 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:31.173357 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82398e76-e0a3-4252-a836-4904afe63274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:31.174167 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82398e76-e0a3-4252-a836-4904afe63274 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:31.174578 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82398e76-e0a3-4252-a836-4904afe63274 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:31.174822 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82398e76-e0a3-4252-a836-4904afe63274 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:31.175487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82398e76-e0a3-4252-a836-4904afe63274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:31.175788 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82398e76-e0a3-4252-a836-4904afe63274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:31.177184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82398e76-e0a3-4252-a836-4904afe63274 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:31.188592 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 606/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:31.194726 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809ab9d-fefd-48da-a028-1beab9fb6199 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:31.204079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:31.303545 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809ab9d-fefd-48da-a028-1beab9fb6199 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:31.342446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b50b5-3446-47b1-8e19-a617af930c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:31.343227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b50b5-3446-47b1-8e19-a617af930c96 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:31.343550 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b50b5-3446-47b1-8e19-a617af930c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:31.343819 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b50b5-3446-47b1-8e19-a617af930c96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:31.352256 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b50b5-3446-47b1-8e19-a617af930c96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:31.353705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b50b5-3446-47b1-8e19-a617af930c96 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-5a9b50b5-3446-47b1-8e19-a617af930c96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:46:31.365778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:31.366934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:31.368149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:46:31.368149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:46:31.368149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:46:31.368149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:46:31.368149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:46:31.368149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:46:31.368149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:31.368149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:31.371795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 624/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:31.372999 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82398e76-e0a3-4252-a836-4904afe63274 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:31.480780 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82398e76-e0a3-4252-a836-4904afe63274 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:31.526080 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16e2c-92cf-4adc-b7d0-b676f80a7bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:31.526721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16e2c-92cf-4adc-b7d0-b676f80a7bbc None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:31.526975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16e2c-92cf-4adc-b7d0-b676f80a7bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:31.527275 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16e2c-92cf-4adc-b7d0-b676f80a7bbc None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:31.527935 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b16e2c-92cf-4adc-b7d0-b676f80a7bbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:31.528288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b16e2c-92cf-4adc-b7d0-b676f80a7bbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:31.529731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b16e2c-92cf-4adc-b7d0-b676f80a7bbc None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:31.543633 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 607/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:31.550613 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b50b5-3446-47b1-8e19-a617af930c96 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:31.620714 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:31.660497 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b50b5-3446-47b1-8e19-a617af930c96 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:31.695330 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c8732-0392-4d23-8f3c-b125a794da49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:31.695997 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8732-0392-4d23-8f3c-b125a794da49 None admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:31.696302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8732-0392-4d23-8f3c-b125a794da49 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:31.696570 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8732-0392-4d23-8f3c-b125a794da49 None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/536ebcc364834a75beefab0f2b0cc196/roles/275b5127bdb241f1bf7690c67d80591b` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:31.711635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c8732-0392-4d23-8f3c-b125a794da49 None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=536ebcc364834a75beefab0f2b0cc196, role_id=275b5127bdb241f1bf7690c67d80591b)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:31.713122 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c8732-0392-4d23-8f3c-b125a794da49 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:31.725994 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 625/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:46:31 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/536ebcc364834a75beefab0f2b0cc196/roles/275b5127bdb241f1bf7690c67d80591b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:46:33.957325 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364162a2-a7f1-41d9-a16d-36a5e43b49e8 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:33.959031 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364162a2-a7f1-41d9-a16d-36a5e43b49e8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:33.959031 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364162a2-a7f1-41d9-a16d-36a5e43b49e8 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:33.959379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 608/1233] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:33.968037 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf66309-9047-4d0f-a322-54f8d822be1d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:33.968037 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf66309-9047-4d0f-a322-54f8d822be1d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:33.968037 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf66309-9047-4d0f-a322-54f8d822be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:33.987142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-2bf66309-9047-4d0f-a322-54f8d822be1d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:33.988635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-2bf66309-9047-4d0f-a322-54f8d822be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:34.061440 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 626/1234] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:34.347801 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364162a2-a7f1-41d9-a16d-36a5e43b49e8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:34.374646 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:34.459299 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364162a2-a7f1-41d9-a16d-36a5e43b49e8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:34.509115 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484937c-f6b3-4643-82a6-71baa1969f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:34.509764 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484937c-f6b3-4643-82a6-71baa1969f8f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:34.510066 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484937c-f6b3-4643-82a6-71baa1969f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:34.510313 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484937c-f6b3-4643-82a6-71baa1969f8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:34.523114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484937c-f6b3-4643-82a6-71baa1969f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-1484937c-f6b3-4643-82a6-71baa1969f8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:46:34.527984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:34.529165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:34.530109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 609/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Sun Oct 9 00:46:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:34.537279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf66309-9047-4d0f-a322-54f8d822be1d None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:34.586065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:34.647210 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf66309-9047-4d0f-a322-54f8d822be1d None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:34.686946 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a9bb5-d427-42ed-a457-73421cc9b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:34.687645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9bb5-d427-42ed-a457-73421cc9b816 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:34.687913 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9bb5-d427-42ed-a457-73421cc9b816 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:34.688261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9bb5-d427-42ed-a457-73421cc9b816 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:34.689020 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a9bb5-d427-42ed-a457-73421cc9b816 None admin] RBAC: Adding query filter params (name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:34.689383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a9bb5-d427-42ed-a457-73421cc9b816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:34.691023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a9bb5-d427-42ed-a457-73421cc9b816 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:34.699831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 627/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Sun Oct 9 00:46:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:34.706144 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484937c-f6b3-4643-82a6-71baa1969f8f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:34.802390 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:34.819766 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484937c-f6b3-4643-82a6-71baa1969f8f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:34.860417 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b41e7-0b26-41c7-8fcd-c5b525ae70a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:34.861235 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b41e7-0b26-41c7-8fcd-c5b525ae70a5 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:34.861861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b41e7-0b26-41c7-8fcd-c5b525ae70a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:34.862261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b41e7-0b26-41c7-8fcd-c5b525ae70a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:34.872825 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b41e7-0b26-41c7-8fcd-c5b525ae70a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:34.874348 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b41e7-0b26-41c7-8fcd-c5b525ae70a5 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-902b41e7-0b26-41c7-8fcd-c5b525ae70a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:34.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:34.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:34.893020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:34.893020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:34.893020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:34.893020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 610/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:46:34.898335 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a9bb5-d427-42ed-a457-73421cc9b816 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:35.010719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a9bb5-d427-42ed-a457-73421cc9b816 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:35.020761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:35.047182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841587e1-ff4e-4d12-884c-26f7c7865aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:35.047880 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841587e1-ff4e-4d12-884c-26f7c7865aed None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:35.048190 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841587e1-ff4e-4d12-884c-26f7c7865aed None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:35.048478 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841587e1-ff4e-4d12-884c-26f7c7865aed None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:35.049114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841587e1-ff4e-4d12-884c-26f7c7865aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:35.049400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841587e1-ff4e-4d12-884c-26f7c7865aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:35.050759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841587e1-ff4e-4d12-884c-26f7c7865aed None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:35.062159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 628/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:35.068521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b41e7-0b26-41c7-8fcd-c5b525ae70a5 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:35.178972 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b41e7-0b26-41c7-8fcd-c5b525ae70a5 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:35.216302 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d86d73-b6a6-4b5a-81e4-f45f7f65f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:35.216936 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d86d73-b6a6-4b5a-81e4-f45f7f65f3cb None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:35.217272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d86d73-b6a6-4b5a-81e4-f45f7f65f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:35.217591 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d86d73-b6a6-4b5a-81e4-f45f7f65f3cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:35.221865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:35.228685 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d86d73-b6a6-4b5a-81e4-f45f7f65f3cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:35.230766 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d86d73-b6a6-4b5a-81e4-f45f7f65f3cb None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-82d86d73-b6a6-4b5a-81e4-f45f7f65f3cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:46:35.245018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:35.246310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:35.247671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:35.247671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:35.247671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:46:35.247671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:46:35.247671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:46:35.247671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:46:35.247671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:46:35.247671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:46:35.247671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:35.247671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:35.247671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 611/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:35.252628 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841587e1-ff4e-4d12-884c-26f7c7865aed None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:35.357390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841587e1-ff4e-4d12-884c-26f7c7865aed None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:35.395126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da0a23-7503-4c1e-8af9-746730bad0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:35.395749 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da0a23-7503-4c1e-8af9-746730bad0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:35.396023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da0a23-7503-4c1e-8af9-746730bad0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:35.396381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da0a23-7503-4c1e-8af9-746730bad0d9 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:35.397126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da0a23-7503-4c1e-8af9-746730bad0d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:35.397410 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da0a23-7503-4c1e-8af9-746730bad0d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:35.398835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da0a23-7503-4c1e-8af9-746730bad0d9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:35.417852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 629/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Oct 9 00:46:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:35.424822 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d86d73-b6a6-4b5a-81e4-f45f7f65f3cb None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:35.540194 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d86d73-b6a6-4b5a-81e4-f45f7f65f3cb None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:35.575379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53660227-ab68-49ed-98d4-8d668e5a1ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:35.575984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53660227-ab68-49ed-98d4-8d668e5a1ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:35.576288 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53660227-ab68-49ed-98d4-8d668e5a1ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:35.576677 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53660227-ab68-49ed-98d4-8d668e5a1ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:35.643687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:35.650616 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53660227-ab68-49ed-98d4-8d668e5a1ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:35.652125 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53660227-ab68-49ed-98d4-8d668e5a1ea9 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:35.757716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 612/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:46:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 09 00:46:35.764598 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da0a23-7503-4c1e-8af9-746730bad0d9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:35.793440 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:35.869061 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da0a23-7503-4c1e-8af9-746730bad0d9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:35.910874 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dddf5f-8a87-4368-af1a-1a0fdd54b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:35.911512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dddf5f-8a87-4368-af1a-1a0fdd54b9ea None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:35.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dddf5f-8a87-4368-af1a-1a0fdd54b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:35.912079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dddf5f-8a87-4368-af1a-1a0fdd54b9ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:35.923666 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dddf5f-8a87-4368-af1a-1a0fdd54b9ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:35.925402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dddf5f-8a87-4368-af1a-1a0fdd54b9ea None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-d3dddf5f-8a87-4368-af1a-1a0fdd54b9ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:35.940795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:35.941932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:35.942904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:35.942904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:35.942904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:35.942904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 630/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:35.948380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53660227-ab68-49ed-98d4-8d668e5a1ea9 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:36.052427 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:36.058437 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53660227-ab68-49ed-98d4-8d668e5a1ea9 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:36.095105 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2e495-c957-4496-adbb-6e3107fdfc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:36.096025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2e495-c957-4496-adbb-6e3107fdfc00 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:36.096364 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2e495-c957-4496-adbb-6e3107fdfc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:36.096639 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2e495-c957-4496-adbb-6e3107fdfc00 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:36.097332 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2e495-c957-4496-adbb-6e3107fdfc00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:36.097651 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2e495-c957-4496-adbb-6e3107fdfc00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:36.099119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2e495-c957-4496-adbb-6e3107fdfc00 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:36.113829 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 613/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:36.119751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dddf5f-8a87-4368-af1a-1a0fdd54b9ea None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:36.201634 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:36.226336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dddf5f-8a87-4368-af1a-1a0fdd54b9ea None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:36.263672 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140ba33-f939-42c0-a794-863b6c6afb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:36.264358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140ba33-f939-42c0-a794-863b6c6afb57 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:36.264630 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140ba33-f939-42c0-a794-863b6c6afb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:36.264898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140ba33-f939-42c0-a794-863b6c6afb57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:36.272327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140ba33-f939-42c0-a794-863b6c6afb57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:36.273795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140ba33-f939-42c0-a794-863b6c6afb57 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-e140ba33-f939-42c0-a794-863b6c6afb57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:46:36.286185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:36.287372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:36.288589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:46:36.288589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:46:36.288589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:46:36.288589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:46:36.288589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:46:36.288589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:46:36.288589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:36.288589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:36.288589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 631/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:36.293492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2e495-c957-4496-adbb-6e3107fdfc00 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:36.407058 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2e495-c957-4496-adbb-6e3107fdfc00 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:36.444468 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac4aba-e96d-485e-85b7-123c083fbc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:36.445110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac4aba-e96d-485e-85b7-123c083fbc18 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:36.445375 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac4aba-e96d-485e-85b7-123c083fbc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:36.445707 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac4aba-e96d-485e-85b7-123c083fbc18 None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:36.446422 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac4aba-e96d-485e-85b7-123c083fbc18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:36.446763 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac4aba-e96d-485e-85b7-123c083fbc18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:36.448235 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac4aba-e96d-485e-85b7-123c083fbc18 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:36.461985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 614/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:36.468367 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140ba33-f939-42c0-a794-863b6c6afb57 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:36.591132 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140ba33-f939-42c0-a794-863b6c6afb57 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:36.626635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f581cfd-8d10-469c-91e4-52597b3d0bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:36.627294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f581cfd-8d10-469c-91e4-52597b3d0bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:36.627567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f581cfd-8d10-469c-91e4-52597b3d0bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:36.627835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f581cfd-8d10-469c-91e4-52597b3d0bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:36.628896 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f581cfd-8d10-469c-91e4-52597b3d0bc3 None admin] RBAC: Adding query filter params (role.id=275b5127bdb241f1bf7690c67d80591b, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=536ebcc364834a75beefab0f2b0cc196) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:36.629227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f581cfd-8d10-469c-91e4-52597b3d0bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:36.630790 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f581cfd-8d10-469c-91e4-52597b3d0bc3 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:36.637083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 632/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:46:36 2022] GET /identity/v3/role_assignments?user.id=536ebcc364834a75beefab0f2b0cc196&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=275b5127bdb241f1bf7690c67d80591b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:38.959910 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53da56-e640-41fd-b80a-6186309f7931 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:38.960549 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53da56-e640-41fd-b80a-6186309f7931 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:38.960549 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53da56-e640-41fd-b80a-6186309f7931 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:38.962032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 615/1247] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:46:38.968125 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84624978-96cd-4b08-9d6a-3a4cb8974d57 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:38.968583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84624978-96cd-4b08-9d6a-3a4cb8974d57 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:38.968676 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84624978-96cd-4b08-9d6a-3a4cb8974d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:38.975015 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:38.988662 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-84624978-96cd-4b08-9d6a-3a4cb8974d57 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:38.990036 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-84624978-96cd-4b08-9d6a-3a4cb8974d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:39.065155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 633/1248] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:46:39.337201 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53da56-e640-41fd-b80a-6186309f7931 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:39.358760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:39.453586 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53da56-e640-41fd-b80a-6186309f7931 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:39.493732 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d02d2-4139-492a-94e1-86e798cfe078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:39.494368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d02d2-4139-492a-94e1-86e798cfe078 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:39.494645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d02d2-4139-492a-94e1-86e798cfe078 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:39.494920 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d02d2-4139-492a-94e1-86e798cfe078 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:39.506100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d02d2-4139-492a-94e1-86e798cfe078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-184d02d2-4139-492a-94e1-86e798cfe078 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:46:39.510864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:39.512439 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:39.513334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 616/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:39.519399 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84624978-96cd-4b08-9d6a-3a4cb8974d57 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:39.624623 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84624978-96cd-4b08-9d6a-3a4cb8974d57 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:39.657731 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:39.664125 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5128a-1537-49ef-ab6a-3a4b14a27d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:39.664736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5128a-1537-49ef-ab6a-3a4b14a27d97 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:39.665013 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5128a-1537-49ef-ab6a-3a4b14a27d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:39.665274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5128a-1537-49ef-ab6a-3a4b14a27d97 None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:39.665929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5128a-1537-49ef-ab6a-3a4b14a27d97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:39.666226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5128a-1537-49ef-ab6a-3a4b14a27d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:39.667580 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5128a-1537-49ef-ab6a-3a4b14a27d97 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:39.675958 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 634/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:46:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:39.682035 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d02d2-4139-492a-94e1-86e798cfe078 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:39.767571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:39.797468 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d02d2-4139-492a-94e1-86e798cfe078 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:39.839543 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e3648-5eb5-41a2-9691-c550ee3f2153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:39.840272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3648-5eb5-41a2-9691-c550ee3f2153 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:39.840576 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3648-5eb5-41a2-9691-c550ee3f2153 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:39.840902 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3648-5eb5-41a2-9691-c550ee3f2153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:39.853082 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e3648-5eb5-41a2-9691-c550ee3f2153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:39.854713 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e3648-5eb5-41a2-9691-c550ee3f2153 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-d77e3648-5eb5-41a2-9691-c550ee3f2153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:39.871062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:39.872261 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:39.873223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:39.873223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:39.873223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:39.873223 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 617/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:46:39.878882 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5128a-1537-49ef-ab6a-3a4b14a27d97 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:39.993422 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5128a-1537-49ef-ab6a-3a4b14a27d97 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:40.032549 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba5d9b-5ef1-4fbc-bb87-2236c517b330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:40.033291 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba5d9b-5ef1-4fbc-bb87-2236c517b330 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:40.033735 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba5d9b-5ef1-4fbc-bb87-2236c517b330 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:40.034092 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba5d9b-5ef1-4fbc-bb87-2236c517b330 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:40.034753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba5d9b-5ef1-4fbc-bb87-2236c517b330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:40.035107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba5d9b-5ef1-4fbc-bb87-2236c517b330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:40.036629 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba5d9b-5ef1-4fbc-bb87-2236c517b330 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:40.049976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 635/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:40.056903 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e3648-5eb5-41a2-9691-c550ee3f2153 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:40.167414 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e3648-5eb5-41a2-9691-c550ee3f2153 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:40.195209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:40.203849 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf54ded-0001-4e48-a94f-337ad267bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:40.204515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf54ded-0001-4e48-a94f-337ad267bd3d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:40.204805 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf54ded-0001-4e48-a94f-337ad267bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:40.205073 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf54ded-0001-4e48-a94f-337ad267bd3d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:40.213270 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf54ded-0001-4e48-a94f-337ad267bd3d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:40.214981 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf54ded-0001-4e48-a94f-337ad267bd3d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-caf54ded-0001-4e48-a94f-337ad267bd3d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:46:40.227133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:40.228515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:40.229721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:40.229721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:40.229721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:46:40.229721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:46:40.229721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:46:40.229721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:46:40.229721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:46:40.229721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:46:40.229721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:40.229721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:40.229721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 618/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:40.235777 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba5d9b-5ef1-4fbc-bb87-2236c517b330 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:40.301669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:40.354460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba5d9b-5ef1-4fbc-bb87-2236c517b330 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:40.393113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a16f4-3333-4fe3-b80e-fed5a5044bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:40.393721 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a16f4-3333-4fe3-b80e-fed5a5044bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:40.394097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a16f4-3333-4fe3-b80e-fed5a5044bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:40.394288 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a16f4-3333-4fe3-b80e-fed5a5044bb1 None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:40.395066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a16f4-3333-4fe3-b80e-fed5a5044bb1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:40.395532 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a16f4-3333-4fe3-b80e-fed5a5044bb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:40.397199 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a16f4-3333-4fe3-b80e-fed5a5044bb1 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:40.418132 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 636/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Oct 9 00:46:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:40.424710 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf54ded-0001-4e48-a94f-337ad267bd3d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:40.556859 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf54ded-0001-4e48-a94f-337ad267bd3d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:40.593622 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b45bf-b057-4e58-934a-29ebd983a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:40.594239 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b45bf-b057-4e58-934a-29ebd983a292 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:40.594521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b45bf-b057-4e58-934a-29ebd983a292 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:40.594794 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b45bf-b057-4e58-934a-29ebd983a292 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:40.657801 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:40.673808 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b45bf-b057-4e58-934a-29ebd983a292 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:40.675676 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b45bf-b057-4e58-934a-29ebd983a292 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:40.785440 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 619/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:46:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:46:40.791615 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a16f4-3333-4fe3-b80e-fed5a5044bb1 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:40.905178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a16f4-3333-4fe3-b80e-fed5a5044bb1 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:40.920677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:40.946456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931e246-f308-46c1-8ff6-41e4d504acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:40.947044 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931e246-f308-46c1-8ff6-41e4d504acef None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:40.947361 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931e246-f308-46c1-8ff6-41e4d504acef None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:40.947657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931e246-f308-46c1-8ff6-41e4d504acef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:40.960723 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931e246-f308-46c1-8ff6-41e4d504acef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:40.962358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931e246-f308-46c1-8ff6-41e4d504acef None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-5931e246-f308-46c1-8ff6-41e4d504acef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:40.978632 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:40.979845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:40.981058 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:40.981058 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:40.981058 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:40.981058 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 637/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:40.988091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b45bf-b057-4e58-934a-29ebd983a292 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:41.082962 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:41.096220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b45bf-b057-4e58-934a-29ebd983a292 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:41.131464 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54638f7f-f14b-429e-871b-5635e0592300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:41.132102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54638f7f-f14b-429e-871b-5635e0592300 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:41.132370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54638f7f-f14b-429e-871b-5635e0592300 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:41.132642 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54638f7f-f14b-429e-871b-5635e0592300 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:41.133264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54638f7f-f14b-429e-871b-5635e0592300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:41.133560 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54638f7f-f14b-429e-871b-5635e0592300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:41.134928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54638f7f-f14b-429e-871b-5635e0592300 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:41.146562 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 620/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:41.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931e246-f308-46c1-8ff6-41e4d504acef None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:41.253789 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931e246-f308-46c1-8ff6-41e4d504acef None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:41.288734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8ebe7-7cd5-423d-bb78-fabaa6227434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:41.289363 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ebe7-7cd5-423d-bb78-fabaa6227434 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:41.289639 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ebe7-7cd5-423d-bb78-fabaa6227434 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:41.289907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ebe7-7cd5-423d-bb78-fabaa6227434 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:41.296813 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8ebe7-7cd5-423d-bb78-fabaa6227434 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:41.298242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8ebe7-7cd5-423d-bb78-fabaa6227434 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-a1e8ebe7-7cd5-423d-bb78-fabaa6227434 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:46:41.309996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:41.311113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:41.312235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:46:41.312235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:46:41.312235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:46:41.312235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:46:41.312235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:46:41.312235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:46:41.312235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:41.312235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:41.312235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 638/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:41.317537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54638f7f-f14b-429e-871b-5635e0592300 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:41.424908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54638f7f-f14b-429e-871b-5635e0592300 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:41.461644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57430bbc-d534-4c0e-86fa-5f971b5d0c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:41.462334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57430bbc-d534-4c0e-86fa-5f971b5d0c8c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:41.462640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57430bbc-d534-4c0e-86fa-5f971b5d0c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:41.462987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57430bbc-d534-4c0e-86fa-5f971b5d0c8c None admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:41.463718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57430bbc-d534-4c0e-86fa-5f971b5d0c8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:41.464174 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57430bbc-d534-4c0e-86fa-5f971b5d0c8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:41.466042 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57430bbc-d534-4c0e-86fa-5f971b5d0c8c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:41.484662 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 621/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:41.492606 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8ebe7-7cd5-423d-bb78-fabaa6227434 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:41.523778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:41.599933 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8ebe7-7cd5-423d-bb78-fabaa6227434 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:41.634823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a883b8-f2c5-4a7f-ba63-ccea23a46969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:41.635417 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a883b8-f2c5-4a7f-ba63-ccea23a46969 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:41.635684 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a883b8-f2c5-4a7f-ba63-ccea23a46969 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:41.635951 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a883b8-f2c5-4a7f-ba63-ccea23a46969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:41.636689 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a883b8-f2c5-4a7f-ba63-ccea23a46969 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=536ebcc364834a75beefab0f2b0cc196) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:41.636990 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a883b8-f2c5-4a7f-ba63-ccea23a46969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:41.638411 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a883b8-f2c5-4a7f-ba63-ccea23a46969 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:41.643755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 639/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:46:41 2022] GET /identity/v3/role_assignments?user.id=536ebcc364834a75beefab0f2b0cc196&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:43.784777 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ae41c-9a5b-46aa-8008-de8103d27ea8 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:43.785373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ae41c-9a5b-46aa-8008-de8103d27ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:43.785373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ae41c-9a5b-46aa-8008-de8103d27ea8 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:43.786644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 622/1261] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:43.792882 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b4db-2f6f-4d8e-bec4-9d011027cb68 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:43.793593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b4db-2f6f-4d8e-bec4-9d011027cb68 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:43.794562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b4db-2f6f-4d8e-bec4-9d011027cb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:43.814659 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-7e77b4db-2f6f-4d8e-bec4-9d011027cb68 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:43.815836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-7e77b4db-2f6f-4d8e-bec4-9d011027cb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:43.884682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 640/1262] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:44.165582 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ae41c-9a5b-46aa-8008-de8103d27ea8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:44.178057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:44.275174 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ae41c-9a5b-46aa-8008-de8103d27ea8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:44.310248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f13da-6ed5-423d-82fb-d13c970719b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:44.310858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f13da-6ed5-423d-82fb-d13c970719b1 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:44.311134 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f13da-6ed5-423d-82fb-d13c970719b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:44.311405 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f13da-6ed5-423d-82fb-d13c970719b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:44.322370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f13da-6ed5-423d-82fb-d13c970719b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-7f0f13da-6ed5-423d-82fb-d13c970719b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:46:44.327133 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:44.328263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:44.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 623/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:44.336609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77b4db-2f6f-4d8e-bec4-9d011027cb68 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:44.356108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:44.446317 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77b4db-2f6f-4d8e-bec4-9d011027cb68 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:44.484539 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cccbd6-8c50-42e3-86dd-2287aafa7b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:44.485281 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cccbd6-8c50-42e3-86dd-2287aafa7b5d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:44.485556 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cccbd6-8c50-42e3-86dd-2287aafa7b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:44.485942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cccbd6-8c50-42e3-86dd-2287aafa7b5d None admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:44.486689 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cccbd6-8c50-42e3-86dd-2287aafa7b5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:44.487040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cccbd6-8c50-42e3-86dd-2287aafa7b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:44.488745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cccbd6-8c50-42e3-86dd-2287aafa7b5d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:44.498834 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 641/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:44.506140 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f13da-6ed5-423d-82fb-d13c970719b1 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:44.580377 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:44.614682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f13da-6ed5-423d-82fb-d13c970719b1 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:44.649882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28848d8f-b7a2-457c-8b8e-cd7a721653a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:44.650488 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848d8f-b7a2-457c-8b8e-cd7a721653a4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:44.650754 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848d8f-b7a2-457c-8b8e-cd7a721653a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:44.651018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848d8f-b7a2-457c-8b8e-cd7a721653a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:44.661547 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28848d8f-b7a2-457c-8b8e-cd7a721653a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:44.662978 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28848d8f-b7a2-457c-8b8e-cd7a721653a4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-28848d8f-b7a2-457c-8b8e-cd7a721653a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:44.677540 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:44.678649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:44.679607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:44.679607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:44.679607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:44.679607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 624/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:44.684708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cccbd6-8c50-42e3-86dd-2287aafa7b5d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:44.768740 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:44.788986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cccbd6-8c50-42e3-86dd-2287aafa7b5d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:44.822681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed6e6c-9999-404f-8f5e-e157cef592b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:44.823380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed6e6c-9999-404f-8f5e-e157cef592b9 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:44.823558 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed6e6c-9999-404f-8f5e-e157cef592b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:44.823875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed6e6c-9999-404f-8f5e-e157cef592b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:44.824545 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed6e6c-9999-404f-8f5e-e157cef592b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:44.824836 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed6e6c-9999-404f-8f5e-e157cef592b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:44.826193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed6e6c-9999-404f-8f5e-e157cef592b9 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:44.838502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 642/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:44.844451 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28848d8f-b7a2-457c-8b8e-cd7a721653a4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:44.953000 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28848d8f-b7a2-457c-8b8e-cd7a721653a4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:44.974866 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:44.994750 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9ec4f-d25c-409b-b77b-d9bc4234534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:44.995749 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9ec4f-d25c-409b-b77b-d9bc4234534c None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:44.996265 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9ec4f-d25c-409b-b77b-d9bc4234534c None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:44.996723 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9ec4f-d25c-409b-b77b-d9bc4234534c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:45.007164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9ec4f-d25c-409b-b77b-d9bc4234534c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:45.008665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9ec4f-d25c-409b-b77b-d9bc4234534c None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-0ff9ec4f-d25c-409b-b77b-d9bc4234534c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:46:45.020968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:45.022097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:45.023278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:45.023278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:45.023278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:46:45.023278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:46:45.023278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:46:45.023278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:46:45.023278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:46:45.023278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:46:45.023278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:45.023278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:45.023278 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 625/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:45.030288 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed6e6c-9999-404f-8f5e-e157cef592b9 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:45.138365 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed6e6c-9999-404f-8f5e-e157cef592b9 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:45.173512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e4272-0df1-4d52-80d5-86eb04e4f11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:45.174107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e4272-0df1-4d52-80d5-86eb04e4f11d None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:45.174350 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e4272-0df1-4d52-80d5-86eb04e4f11d None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:45.174638 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e4272-0df1-4d52-80d5-86eb04e4f11d None admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:45.175342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e4272-0df1-4d52-80d5-86eb04e4f11d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:45.175647 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e4272-0df1-4d52-80d5-86eb04e4f11d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:45.177089 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e4272-0df1-4d52-80d5-86eb04e4f11d None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:45.186638 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:45.196756 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 643/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Oct 9 00:46:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:45.203583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9ec4f-d25c-409b-b77b-d9bc4234534c None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:45.309793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9ec4f-d25c-409b-b77b-d9bc4234534c None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:45.344928 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ea538-3cbd-4b95-84cb-be834e1858b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:45.345593 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ea538-3cbd-4b95-84cb-be834e1858b4 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:45.345875 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ea538-3cbd-4b95-84cb-be834e1858b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:45.346137 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ea538-3cbd-4b95-84cb-be834e1858b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:45.357083 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ea538-3cbd-4b95-84cb-be834e1858b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:45.358534 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ea538-3cbd-4b95-84cb-be834e1858b4 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-b02ea538-3cbd-4b95-84cb-be834e1858b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:45.372905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:45.374011 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:45.374959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:45.374959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:45.374959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:45.374959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 626/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:45.383557 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e4272-0df1-4d52-80d5-86eb04e4f11d None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:45.502338 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e4272-0df1-4d52-80d5-86eb04e4f11d None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:45.539631 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c00647-13be-412b-a060-3dda613fc507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:45.540261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00647-13be-412b-a060-3dda613fc507 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:45.540538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00647-13be-412b-a060-3dda613fc507 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:45.540808 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00647-13be-412b-a060-3dda613fc507 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:45.541441 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c00647-13be-412b-a060-3dda613fc507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:45.541743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c00647-13be-412b-a060-3dda613fc507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:45.543099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c00647-13be-412b-a060-3dda613fc507 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:45.554404 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 644/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:45.564075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ea538-3cbd-4b95-84cb-be834e1858b4 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:45.609372 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:45.681689 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ea538-3cbd-4b95-84cb-be834e1858b4 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:45.721332 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca06e5-959f-44a6-9beb-e889ea77f4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:45.721964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca06e5-959f-44a6-9beb-e889ea77f4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:45.722237 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca06e5-959f-44a6-9beb-e889ea77f4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:45.722500 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca06e5-959f-44a6-9beb-e889ea77f4c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:45.729679 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca06e5-959f-44a6-9beb-e889ea77f4c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:45.731193 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca06e5-959f-44a6-9beb-e889ea77f4c8 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-61ca06e5-959f-44a6-9beb-e889ea77f4c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:46:45.743478 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:45.744571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:45.745846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:46:45.745846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:46:45.745846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:46:45.745846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:46:45.745846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:46:45.745846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:46:45.745846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:45.745846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:45.745846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 627/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:46:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:45.750647 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c00647-13be-412b-a060-3dda613fc507 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:45.816945 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:45.863098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c00647-13be-412b-a060-3dda613fc507 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:45.900087 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ca725-04c7-44dc-bbdc-5626e32ee545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:45.900708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ca725-04c7-44dc-bbdc-5626e32ee545 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:45.900979 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ca725-04c7-44dc-bbdc-5626e32ee545 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:45.901242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ca725-04c7-44dc-bbdc-5626e32ee545 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:45.901916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ca725-04c7-44dc-bbdc-5626e32ee545 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:45.902205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ca725-04c7-44dc-bbdc-5626e32ee545 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:45.903627 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ca725-04c7-44dc-bbdc-5626e32ee545 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:45.916381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 645/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:46:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:45.925381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca06e5-959f-44a6-9beb-e889ea77f4c8 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:46.022495 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:46.032752 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca06e5-959f-44a6-9beb-e889ea77f4c8 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:46.068095 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5994e-9cdf-4b8d-8e83-e8c41cf38290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:46.068682 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5994e-9cdf-4b8d-8e83-e8c41cf38290 None admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:46.068931 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5994e-9cdf-4b8d-8e83-e8c41cf38290 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:46.069219 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5994e-9cdf-4b8d-8e83-e8c41cf38290 None admin] PATH_INFO: `/v3/projects/a56c49f0d75c457ca693240c8a221037/users/536ebcc364834a75beefab0f2b0cc196/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:46.071175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5994e-9cdf-4b8d-8e83-e8c41cf38290 None admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49f0d75c457ca693240c8a221037, user_id=536ebcc364834a75beefab0f2b0cc196, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:46.072650 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5994e-9cdf-4b8d-8e83-e8c41cf38290 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:46.088152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 628/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Sun Oct 9 00:46:45 2022] PUT /identity/v3/projects/a56c49f0d75c457ca693240c8a221037/users/536ebcc364834a75beefab0f2b0cc196/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:46:48.216368 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea25733-cfad-4283-b220-631264c1d41b None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:48.216916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea25733-cfad-4283-b220-631264c1d41b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:48.216916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea25733-cfad-4283-b220-631264c1d41b None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:48.218248 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 646/1274] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:48.224964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb64a08-60ab-4161-98d8-60027aca64dc None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:48.225651 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb64a08-60ab-4161-98d8-60027aca64dc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:48.225768 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb64a08-60ab-4161-98d8-60027aca64dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:48.250142 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2bb64a08-60ab-4161-98d8-60027aca64dc None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:48.251364 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2bb64a08-60ab-4161-98d8-60027aca64dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:48.323914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 629/1275] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:48.605075 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea25733-cfad-4283-b220-631264c1d41b None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:48.722373 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea25733-cfad-4283-b220-631264c1d41b None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:48.740574 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:48.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e024d7a-10ee-4b07-9a85-e71f70eec2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:48.761044 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e024d7a-10ee-4b07-9a85-e71f70eec2ce None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:48.761313 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e024d7a-10ee-4b07-9a85-e71f70eec2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:48.761573 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e024d7a-10ee-4b07-9a85-e71f70eec2ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:48.771640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e024d7a-10ee-4b07-9a85-e71f70eec2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-8e024d7a-10ee-4b07-9a85-e71f70eec2ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:46:48.776371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:48.777466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:48.778388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 647/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Sun Oct 9 00:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:48.783955 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb64a08-60ab-4161-98d8-60027aca64dc None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:48.877762 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:48.898463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb64a08-60ab-4161-98d8-60027aca64dc None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:48.936344 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fea55-aa66-4f05-a3de-643e06a2e5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:48.936941 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fea55-aa66-4f05-a3de-643e06a2e5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:48.937215 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fea55-aa66-4f05-a3de-643e06a2e5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:48.937479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fea55-aa66-4f05-a3de-643e06a2e5e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:48.938135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fea55-aa66-4f05-a3de-643e06a2e5e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:48.938423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fea55-aa66-4f05-a3de-643e06a2e5e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:48.939853 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fea55-aa66-4f05-a3de-643e06a2e5e2 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:48.947883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 630/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Sun Oct 9 00:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:48.954315 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e024d7a-10ee-4b07-9a85-e71f70eec2ce None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:49.056878 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e024d7a-10ee-4b07-9a85-e71f70eec2ce None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:49.094670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7baf72-4588-4c8e-8ad2-e0aad83c838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:49.095475 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7baf72-4588-4c8e-8ad2-e0aad83c838b None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:49.095759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7baf72-4588-4c8e-8ad2-e0aad83c838b None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:49.096021 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7baf72-4588-4c8e-8ad2-e0aad83c838b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:49.106976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7baf72-4588-4c8e-8ad2-e0aad83c838b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:49.108432 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7baf72-4588-4c8e-8ad2-e0aad83c838b None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-dd7baf72-4588-4c8e-8ad2-e0aad83c838b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:49.123019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:49.124263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:49.125261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:49.125261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:49.125261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:49.125261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 648/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:49.133246 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fea55-aa66-4f05-a3de-643e06a2e5e2 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:49.237330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fea55-aa66-4f05-a3de-643e06a2e5e2 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:49.272281 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd32ef4-d927-4edc-b04f-73162bef7861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:49.272865 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd32ef4-d927-4edc-b04f-73162bef7861 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:49.273135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd32ef4-d927-4edc-b04f-73162bef7861 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:49.273398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd32ef4-d927-4edc-b04f-73162bef7861 None admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:49.274018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd32ef4-d927-4edc-b04f-73162bef7861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:49.274310 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd32ef4-d927-4edc-b04f-73162bef7861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:49.275672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd32ef4-d927-4edc-b04f-73162bef7861 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:49.287213 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 631/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:49.293153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7baf72-4588-4c8e-8ad2-e0aad83c838b None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:49.326216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:49.397939 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7baf72-4588-4c8e-8ad2-e0aad83c838b None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:49.436481 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca94c6d-9fbc-40e9-b00f-b4c893059b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:49.437097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94c6d-9fbc-40e9-b00f-b4c893059b0c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:49.437367 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94c6d-9fbc-40e9-b00f-b4c893059b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:49.437631 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94c6d-9fbc-40e9-b00f-b4c893059b0c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:49.445387 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca94c6d-9fbc-40e9-b00f-b4c893059b0c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:49.446816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca94c6d-9fbc-40e9-b00f-b4c893059b0c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-fca94c6d-9fbc-40e9-b00f-b4c893059b0c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:46:49.458116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:49.459300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:49.460857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:49.460857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:49.460857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:46:49.460857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:46:49.460857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:46:49.460857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:46:49.460857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:46:49.460857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:46:49.460857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:49.460857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:49.460857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 649/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:49.465798 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd32ef4-d927-4edc-b04f-73162bef7861 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:49.471114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:49.581130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd32ef4-d927-4edc-b04f-73162bef7861 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:49.618044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aa486-bbaa-4b3c-9050-b634f7967195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:49.618637 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa486-bbaa-4b3c-9050-b634f7967195 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:49.618910 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa486-bbaa-4b3c-9050-b634f7967195 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:49.619172 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa486-bbaa-4b3c-9050-b634f7967195 None admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:49.619885 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2aa486-bbaa-4b3c-9050-b634f7967195 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:49.620212 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2aa486-bbaa-4b3c-9050-b634f7967195 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:49.621661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2aa486-bbaa-4b3c-9050-b634f7967195 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:49.640847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 632/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Sun Oct 9 00:46:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:49.647574 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca94c6d-9fbc-40e9-b00f-b4c893059b0c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:49.742655 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:49.755415 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca94c6d-9fbc-40e9-b00f-b4c893059b0c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:49.799368 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee80d9-8680-4b85-87f0-0796d124291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:49.799977 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee80d9-8680-4b85-87f0-0796d124291c None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:49.800272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee80d9-8680-4b85-87f0-0796d124291c None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:49.800518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee80d9-8680-4b85-87f0-0796d124291c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:49.871944 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee80d9-8680-4b85-87f0-0796d124291c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:49.873378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee80d9-8680-4b85-87f0-0796d124291c None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:49.962261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:49.978925 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 650/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Sun Oct 9 00:46:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:46:49.988349 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aa486-bbaa-4b3c-9050-b634f7967195 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:50.061702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:50.103006 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aa486-bbaa-4b3c-9050-b634f7967195 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:50.142716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17865166-5613-42d6-91e5-b6539e30bac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:50.143336 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17865166-5613-42d6-91e5-b6539e30bac3 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:50.143612 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17865166-5613-42d6-91e5-b6539e30bac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:50.143879 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17865166-5613-42d6-91e5-b6539e30bac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:50.155404 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17865166-5613-42d6-91e5-b6539e30bac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:50.157036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17865166-5613-42d6-91e5-b6539e30bac3 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-17865166-5613-42d6-91e5-b6539e30bac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:50.171963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:50.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:50.174631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:50.174631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:50.174631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:50.174631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 633/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:50.181086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee80d9-8680-4b85-87f0-0796d124291c None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:50.282115 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee80d9-8680-4b85-87f0-0796d124291c None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:50.319642 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b21a-9db7-4307-80fc-9a6289ba9c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:50.320290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b21a-9db7-4307-80fc-9a6289ba9c68 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:50.320441 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b21a-9db7-4307-80fc-9a6289ba9c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:50.320733 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b21a-9db7-4307-80fc-9a6289ba9c68 None admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:50.321363 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b21a-9db7-4307-80fc-9a6289ba9c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:50.321652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b21a-9db7-4307-80fc-9a6289ba9c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:50.323005 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b21a-9db7-4307-80fc-9a6289ba9c68 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:50.334738 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 651/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:50.340649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17865166-5613-42d6-91e5-b6539e30bac3 None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:50.447052 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17865166-5613-42d6-91e5-b6539e30bac3 None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:50.461690 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:50.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa3b84-f463-42bd-bba9-2a82a994a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:50.493030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa3b84-f463-42bd-bba9-2a82a994a28d None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:50.493304 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa3b84-f463-42bd-bba9-2a82a994a28d None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:50.493572 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa3b84-f463-42bd-bba9-2a82a994a28d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:50.500656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa3b84-f463-42bd-bba9-2a82a994a28d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:50.502227 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa3b84-f463-42bd-bba9-2a82a994a28d None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application [None req-fbaa3b84-f463-42bd-bba9-2a82a994a28d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:46:50.513846 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:50.514860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:50.515963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:46:50.515963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:46:50.515963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:46:50.515963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:46:50.515963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:46:50.515963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:46:50.515963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:50.515963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: ERROR keystone.server.flask.application Oct 09 00:46:50.515963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 634/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Sun Oct 9 00:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:50.521203 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b21a-9db7-4307-80fc-9a6289ba9c68 None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:50.576929 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:50.641309 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b21a-9db7-4307-80fc-9a6289ba9c68 None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:50.676731 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65448c-d0d7-44f4-84d4-230e759e8c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:50.677328 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65448c-d0d7-44f4-84d4-230e759e8c98 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:50.677600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65448c-d0d7-44f4-84d4-230e759e8c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:50.677869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65448c-d0d7-44f4-84d4-230e759e8c98 None admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:50.678543 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65448c-d0d7-44f4-84d4-230e759e8c98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:50.678841 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65448c-d0d7-44f4-84d4-230e759e8c98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:50.680293 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65448c-d0d7-44f4-84d4-230e759e8c98 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:50.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 652/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Sun Oct 9 00:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:50.699183 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa3b84-f463-42bd-bba9-2a82a994a28d None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:50.818090 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa3b84-f463-42bd-bba9-2a82a994a28d None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:50.852064 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d86d27-2747-4d56-9d13-0726140e8f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:50.852591 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d86d27-2747-4d56-9d13-0726140e8f38 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:50.852862 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d86d27-2747-4d56-9d13-0726140e8f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:50.853122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d86d27-2747-4d56-9d13-0726140e8f38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:50.853819 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d86d27-2747-4d56-9d13-0726140e8f38 None admin] RBAC: Adding query filter params (role.id=3ecd48367a4144eda99e3e0ca7e4748f, scope.project.id=a56c49f0d75c457ca693240c8a221037, user.id=536ebcc364834a75beefab0f2b0cc196) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:50.854112 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d86d27-2747-4d56-9d13-0726140e8f38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:50.855545 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d86d27-2747-4d56-9d13-0726140e8f38 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:50.861393 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 635/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Sun Oct 9 00:46:50 2022] GET /identity/v3/role_assignments?user.id=536ebcc364834a75beefab0f2b0cc196&scope.project.id=a56c49f0d75c457ca693240c8a221037&role.id=3ecd48367a4144eda99e3e0ca7e4748f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:53.007277 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184447-d095-4a09-a203-62dd2b38ad22 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:53.007871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184447-d095-4a09-a203-62dd2b38ad22 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:53.007871 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184447-d095-4a09-a203-62dd2b38ad22 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:53.009202 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 653/1288] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:53.015627 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7763f68-a136-4f0c-9cd4-8f75ec4eca8b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:53.016395 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7763f68-a136-4f0c-9cd4-8f75ec4eca8b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:53.016588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7763f68-a136-4f0c-9cd4-8f75ec4eca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:53.040889 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a7763f68-a136-4f0c-9cd4-8f75ec4eca8b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:53.042136 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a7763f68-a136-4f0c-9cd4-8f75ec4eca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:53.073909 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:53.113307 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 636/1289] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:53.378877 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184447-d095-4a09-a203-62dd2b38ad22 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:53.519594 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184447-d095-4a09-a203-62dd2b38ad22 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:53.532911 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:53.561940 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fdcb5-8030-48ec-a33c-a34b6f1ed7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:53.562568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fdcb5-8030-48ec-a33c-a34b6f1ed7ed None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:53.562960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fdcb5-8030-48ec-a33c-a34b6f1ed7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:53.563229 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fdcb5-8030-48ec-a33c-a34b6f1ed7ed None admin] PATH_INFO: `/v3/services/placement` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:53.563838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fdcb5-8030-48ec-a33c-a34b6f1ed7ed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:53.565412 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fdcb5-8030-48ec-a33c-a34b6f1ed7ed None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-6b8fdcb5-8030-48ec-a33c-a34b6f1ed7ed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:53.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:53.576456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:53.577567 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 654/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Oct 9 00:46:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:53.582503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7763f68-a136-4f0c-9cd4-8f75ec4eca8b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:53.685769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7763f68-a136-4f0c-9cd4-8f75ec4eca8b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:53.721164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25318d-905a-4143-9d6f-4dc34bc50314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:53.721759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25318d-905a-4143-9d6f-4dc34bc50314 None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:53.722031 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25318d-905a-4143-9d6f-4dc34bc50314 None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:53.722296 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25318d-905a-4143-9d6f-4dc34bc50314 None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:53.722895 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25318d-905a-4143-9d6f-4dc34bc50314 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:53.723190 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25318d-905a-4143-9d6f-4dc34bc50314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:53.724597 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25318d-905a-4143-9d6f-4dc34bc50314 None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:53.729503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 637/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Sun Oct 9 00:46:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:53.739114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fdcb5-8030-48ec-a33c-a34b6f1ed7ed None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:53.849264 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fdcb5-8030-48ec-a33c-a34b6f1ed7ed None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:53.884137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a538c-81e1-4c01-8879-bbe205c0d485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:53.884735 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a538c-81e1-4c01-8879-bbe205c0d485 None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:53.885009 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a538c-81e1-4c01-8879-bbe205c0d485 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:53.885275 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a538c-81e1-4c01-8879-bbe205c0d485 None admin] PATH_INFO: `/v3/services` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:53.885889 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a538c-81e1-4c01-8879-bbe205c0d485 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:53.886185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a538c-81e1-4c01-8879-bbe205c0d485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:53.887535 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a538c-81e1-4c01-8879-bbe205c0d485 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:53.892669 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 655/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Sun Oct 9 00:46:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:56.037248 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104abe-7882-4c4f-b6b4-f9059bee8a28 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:56.038100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104abe-7882-4c4f-b6b4-f9059bee8a28 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:56.038100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104abe-7882-4c4f-b6b4-f9059bee8a28 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:56.040127 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 638/1293] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:46:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:56.046593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aa8a2-833e-4ac9-a5b7-fad931d12fcd None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:56.047349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aa8a2-833e-4ac9-a5b7-fad931d12fcd None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:56.047349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aa8a2-833e-4ac9-a5b7-fad931d12fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:56.072437 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-086aa8a2-833e-4ac9-a5b7-fad931d12fcd None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:56.073603 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-086aa8a2-833e-4ac9-a5b7-fad931d12fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:56.106859 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:56.153917 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 656/1294] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:56.415062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26104abe-7882-4c4f-b6b4-f9059bee8a28 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:56.449445 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:56.538944 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26104abe-7882-4c4f-b6b4-f9059bee8a28 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:56.579151 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781e598-67f4-4208-8d9f-30b20406968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:56.579952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e598-67f4-4208-8d9f-30b20406968a None admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:56.580229 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e598-67f4-4208-8d9f-30b20406968a None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:56.580517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e598-67f4-4208-8d9f-30b20406968a None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:56.581155 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781e598-67f4-4208-8d9f-30b20406968a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:56.582521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781e598-67f4-4208-8d9f-30b20406968a None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:56.600544 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 639/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Sun Oct 9 00:46:56 2022] POST /identity/v3/services => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:46:58.886161 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257396d-503a-4f54-8cdc-f63bd0705d28 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:58.887057 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257396d-503a-4f54-8cdc-f63bd0705d28 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:58.887057 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257396d-503a-4f54-8cdc-f63bd0705d28 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:58.889231 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 657/1296] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:46:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:58.896218 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe6681-4265-4211-837d-71a53cb1868d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:58.896862 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe6681-4265-4211-837d-71a53cb1868d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:58.897010 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe6681-4265-4211-837d-71a53cb1868d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:58.922138 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-45fe6681-4265-4211-837d-71a53cb1868d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:58.923335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-45fe6681-4265-4211-837d-71a53cb1868d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:59.022841 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 640/1297] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:59.302494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257396d-503a-4f54-8cdc-f63bd0705d28 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:59.419765 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257396d-503a-4f54-8cdc-f63bd0705d28 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:59.457701 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc799d-14af-40fa-bb71-7f57d9a575fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:59.458439 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc799d-14af-40fa-bb71-7f57d9a575fe None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:59.458747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc799d-14af-40fa-bb71-7f57d9a575fe None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:59.459040 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc799d-14af-40fa-bb71-7f57d9a575fe None admin] PATH_INFO: `/v3/services/placement` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:59.459694 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc799d-14af-40fa-bb71-7f57d9a575fe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:59.461342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc799d-14af-40fa-bb71-7f57d9a575fe None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-87fc799d-14af-40fa-bb71-7f57d9a575fe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:59.472991 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:46:59.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 658/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Oct 9 00:46:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:59.482834 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe6681-4265-4211-837d-71a53cb1868d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:59.513234 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:59.618661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe6681-4265-4211-837d-71a53cb1868d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:59.658630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb326341-a259-4827-ae5c-9a7dcc06f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:59.659239 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb326341-a259-4827-ae5c-9a7dcc06f35f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:59.659644 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb326341-a259-4827-ae5c-9a7dcc06f35f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:59.659911 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb326341-a259-4827-ae5c-9a7dcc06f35f None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:59.660659 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb326341-a259-4827-ae5c-9a7dcc06f35f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:59.660957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb326341-a259-4827-ae5c-9a7dcc06f35f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:59.662326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb326341-a259-4827-ae5c-9a7dcc06f35f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:59.667789 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 641/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Sun Oct 9 00:46:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:59.674235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc799d-14af-40fa-bb71-7f57d9a575fe None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:59.709960 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:59.779675 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc799d-14af-40fa-bb71-7f57d9a575fe None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:59.814445 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54d2a8-2f9a-431f-8f58-596578e17bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:59.815037 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54d2a8-2f9a-431f-8f58-596578e17bea None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:59.815305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54d2a8-2f9a-431f-8f58-596578e17bea None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:59.815568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54d2a8-2f9a-431f-8f58-596578e17bea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:59.816275 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54d2a8-2f9a-431f-8f58-596578e17bea None admin] RBAC: Adding query filter params (interface=public, service_id=e6531634a9684de5ba70dacf3b569dcd, region_id=RegionOne) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:59.816576 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54d2a8-2f9a-431f-8f58-596578e17bea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:59.817919 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54d2a8-2f9a-431f-8f58-596578e17bea None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:59.822915 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 659/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Sun Oct 9 00:46:59 2022] GET /identity/v3/endpoints?service_id=e6531634a9684de5ba70dacf3b569dcd&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:59.828702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb326341-a259-4827-ae5c-9a7dcc06f35f None admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:59.911172 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:59.930913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb326341-a259-4827-ae5c-9a7dcc06f35f None admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:59.964521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40ae84-acf0-4735-b049-07428feb408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:59.965114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ae84-acf0-4735-b049-07428feb408e None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:59.965381 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ae84-acf0-4735-b049-07428feb408e None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:59.965643 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ae84-acf0-4735-b049-07428feb408e None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:59.966225 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40ae84-acf0-4735-b049-07428feb408e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:59.967585 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40ae84-acf0-4735-b049-07428feb408e None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:59.974607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 642/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Sun Oct 9 00:46:59 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:47:02.089451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660e3e-d6e8-46a7-92ac-668132a1893a None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:02.090360 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660e3e-d6e8-46a7-92ac-668132a1893a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:02.090360 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660e3e-d6e8-46a7-92ac-668132a1893a None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:02.092401 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 660/1302] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:47:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:47:02.097855 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aa804-d9fd-40a1-b5fc-a52a3a924e3d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:02.098297 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aa804-d9fd-40a1-b5fc-a52a3a924e3d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:02.098408 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aa804-d9fd-40a1-b5fc-a52a3a924e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:02.117869 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5c4aa804-d9fd-40a1-b5fc-a52a3a924e3d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:47:02.119038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5c4aa804-d9fd-40a1-b5fc-a52a3a924e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:02.187284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 643/1303] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:47:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:47:02.450771 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660e3e-d6e8-46a7-92ac-668132a1893a None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:47:02.557444 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:02.569394 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660e3e-d6e8-46a7-92ac-668132a1893a None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:47:02.610880 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350bb21-50ce-4093-bb1c-cc377d01009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:47:02.611491 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350bb21-50ce-4093-bb1c-cc377d01009a None admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:02.611784 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350bb21-50ce-4093-bb1c-cc377d01009a None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:02.612081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350bb21-50ce-4093-bb1c-cc377d01009a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:02.612651 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350bb21-50ce-4093-bb1c-cc377d01009a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:47:02.614080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350bb21-50ce-4093-bb1c-cc377d01009a None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application [None req-8350bb21-50ce-4093-bb1c-cc377d01009a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:47:02.623383 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:47:02.624562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application with Lock( Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: ERROR keystone.server.flask.application Oct 09 00:47:02.625907 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 661/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Sun Oct 9 00:47:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:47:02.634680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aa804-d9fd-40a1-b5fc-a52a3a924e3d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:47:02.734062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:02.761116 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aa804-d9fd-40a1-b5fc-a52a3a924e3d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:47:02.799027 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547156b9-3b25-4279-9c41-55f88643c81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:47:02.799693 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547156b9-3b25-4279-9c41-55f88643c81f None admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:02.800008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547156b9-3b25-4279-9c41-55f88643c81f None admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:02.800315 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547156b9-3b25-4279-9c41-55f88643c81f None admin] PATH_INFO: `/v3/services` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:02.800986 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547156b9-3b25-4279-9c41-55f88643c81f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:47:02.801292 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547156b9-3b25-4279-9c41-55f88643c81f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:47:02.802760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547156b9-3b25-4279-9c41-55f88643c81f None admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:47:02.808675 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 644/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Sun Oct 9 00:47:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:47:02.814886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350bb21-50ce-4093-bb1c-cc377d01009a None admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:47:02.920157 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350bb21-50ce-4093-bb1c-cc377d01009a None admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:47:02.963428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd146d-77f8-4d02-b162-81e28ad9ea41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:47:02.964021 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd146d-77f8-4d02-b162-81e28ad9ea41 None admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:02.964323 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd146d-77f8-4d02-b162-81e28ad9ea41 None admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:02.964587 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd146d-77f8-4d02-b162-81e28ad9ea41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:02.965240 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd146d-77f8-4d02-b162-81e28ad9ea41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:47:02.966590 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd146d-77f8-4d02-b162-81e28ad9ea41 None admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:47:02.995323 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 662/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:47:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:47:12.805026 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=30 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:12.987994 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:07.477000 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625f8e-ba50-48ac-af26-2bc0e0fc7746 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:07.477492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625f8e-ba50-48ac-af26-2bc0e0fc7746 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:07.477573 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625f8e-ba50-48ac-af26-2bc0e0fc7746 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:07.484224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc6e72-b3c6-4dbc-b002-e4e80fa543d3 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:07.484659 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc6e72-b3c6-4dbc-b002-e4e80fa543d3 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:07.484741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc6e72-b3c6-4dbc-b002-e4e80fa543d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:07.489539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 645/1307] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:07 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:07.704949 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-0ccc6e72-b3c6-4dbc-b002-e4e80fa543d3 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:07.720810 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-0ccc6e72-b3c6-4dbc-b002-e4e80fa543d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:07.888187 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 663/1308] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:48:08.165180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaccba-d1d7-4a05-811f-595d1178026b None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:08.165819 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaccba-d1d7-4a05-811f-595d1178026b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:08.166284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaccba-d1d7-4a05-811f-595d1178026b None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:08.167821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 646/1309] 10.222.0.43 () {54 vars in 964 bytes} [Sun Oct 9 00:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:08.174209 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccde6-4766-48a2-845a-f22c4a19a543 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:08.174494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccde6-4766-48a2-845a-f22c4a19a543 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:08.174766 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eccde6-4766-48a2-845a-f22c4a19a543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:08.266744 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-e4eccde6-4766-48a2-845a-f22c4a19a543 None None] MFA Rules not processed for user `a33cbccb6a374b5f941fd4b768ff6766`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:08.267974 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e4eccde6-4766-48a2-845a-f22c4a19a543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:08.292177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:08.367354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaccba-d1d7-4a05-811f-595d1178026b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:08.369157 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2fbaccba-d1d7-4a05-811f-595d1178026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:08.376438 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 664/1310] 10.222.0.43 () {58 vars in 1061 bytes} [Sun Oct 9 00:48:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:48:08.485983 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaccba-d1d7-4a05-811f-595d1178026b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:08.564636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872c0c7-ebc8-4446-8b16-02db43dc25e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:08.565255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c0c7-ebc8-4446-8b16-02db43dc25e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:08.565528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c0c7-ebc8-4446-8b16-02db43dc25e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:08.565796 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c0c7-ebc8-4446-8b16-02db43dc25e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:08.567455 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7872c0c7-ebc8-4446-8b16-02db43dc25e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:08.630372 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:08.694138 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872c0c7-ebc8-4446-8b16-02db43dc25e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:08.695741 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872c0c7-ebc8-4446-8b16-02db43dc25e4 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:08.730780 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 647/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:48:11.124111 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc579-fa91-40a0-bf80-4d5ec2c2e39d None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:11.124666 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc579-fa91-40a0-bf80-4d5ec2c2e39d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:11.124666 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc579-fa91-40a0-bf80-4d5ec2c2e39d None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:11.126060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 665/1312] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:11.132102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4845070-3021-45c6-9dd3-ff3c43e64021 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:11.132707 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4845070-3021-45c6-9dd3-ff3c43e64021 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:11.132707 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4845070-3021-45c6-9dd3-ff3c43e64021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:11.202645 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-a4845070-3021-45c6-9dd3-ff3c43e64021 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:11.203840 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a4845070-3021-45c6-9dd3-ff3c43e64021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:11.304633 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 648/1313] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:11.606537 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010bb45-be3b-4064-a7c8-805b370f7d53 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:11.606831 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010bb45-be3b-4064-a7c8-805b370f7d53 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:11.607170 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010bb45-be3b-4064-a7c8-805b370f7d53 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:11.609541 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 666/1314] 10.222.0.43 () {54 vars in 964 bytes} [Sun Oct 9 00:48:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:11.615679 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfb29b-3d58-4ce7-bd2f-3e1ccedbfa2c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:11.615970 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfb29b-3d58-4ce7-bd2f-3e1ccedbfa2c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:11.616272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfb29b-3d58-4ce7-bd2f-3e1ccedbfa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:11.628805 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:11.698768 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-03cfb29b-3d58-4ce7-bd2f-3e1ccedbfa2c None None] MFA Rules not processed for user `a33cbccb6a374b5f941fd4b768ff6766`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:11.699889 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-03cfb29b-3d58-4ce7-bd2f-3e1ccedbfa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:11.786813 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 649/1315] 10.222.0.43 () {58 vars in 1061 bytes} [Sun Oct 9 00:48:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:11.799153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010bb45-be3b-4064-a7c8-805b370f7d53 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:11.801544 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-6010bb45-be3b-4064-a7c8-805b370f7d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:11.923615 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010bb45-be3b-4064-a7c8-805b370f7d53 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:11.998822 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:12.001463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b280c7b-de96-4a18-9ad6-963737e9083e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:12.002424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280c7b-de96-4a18-9ad6-963737e9083e service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:12.002711 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280c7b-de96-4a18-9ad6-963737e9083e service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:12.002998 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280c7b-de96-4a18-9ad6-963737e9083e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:12.005732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-9b280c7b-de96-4a18-9ad6-963737e9083e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:12.125352 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b280c7b-de96-4a18-9ad6-963737e9083e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:12.127109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b280c7b-de96-4a18-9ad6-963737e9083e service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:12.146457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 667/1316] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:14.832587 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4dc9b-3528-4d79-a7fe-9ca700efc343 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:14.833134 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4dc9b-3528-4d79-a7fe-9ca700efc343 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:14.833692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4dc9b-3528-4d79-a7fe-9ca700efc343 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:14.836231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 650/1317] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:14.844863 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ef2a-d85d-45bf-935c-452b923fcb14 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:14.845338 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ef2a-d85d-45bf-935c-452b923fcb14 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:14.845433 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ef2a-d85d-45bf-935c-452b923fcb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:14.915868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-6b51ef2a-d85d-45bf-935c-452b923fcb14 None None] MFA Rules not processed for user `6f02ba7b97474cd7bb2e02b3f9f8106e`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:14.917132 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-6b51ef2a-d85d-45bf-935c-452b923fcb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:14.972498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:15.023290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 668/1318] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:15.309699 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4dc9b-3528-4d79-a7fe-9ca700efc343 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:15.311233 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-25d4dc9b-3528-4d79-a7fe-9ca700efc343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:15.423021 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4dc9b-3528-4d79-a7fe-9ca700efc343 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:15.425853 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:15.501424 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12562b53-3c59-4a60-9de0-3e8c8f7fc365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:15.502368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562b53-3c59-4a60-9de0-3e8c8f7fc365 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:15.502640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562b53-3c59-4a60-9de0-3e8c8f7fc365 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:15.502906 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12562b53-3c59-4a60-9de0-3e8c8f7fc365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:15.504487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-12562b53-3c59-4a60-9de0-3e8c8f7fc365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:15.628203 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12562b53-3c59-4a60-9de0-3e8c8f7fc365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:15.629571 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12562b53-3c59-4a60-9de0-3e8c8f7fc365 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:15.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 651/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:18.485517 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a273ef5-4433-48bb-9b75-5833ceb0e448 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:18.486096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a273ef5-4433-48bb-9b75-5833ceb0e448 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:18.486096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a273ef5-4433-48bb-9b75-5833ceb0e448 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:18.487397 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 669/1320] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:18.493925 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321109-1a5b-45e7-a1dd-60884caed936 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:18.494625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321109-1a5b-45e7-a1dd-60884caed936 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:18.494848 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321109-1a5b-45e7-a1dd-60884caed936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:18.543046 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:18.574922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6b321109-1a5b-45e7-a1dd-60884caed936 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:18.576162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6b321109-1a5b-45e7-a1dd-60884caed936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:18.680964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 652/1321] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:18.964925 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a273ef5-4433-48bb-9b75-5833ceb0e448 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:18.967284 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3a273ef5-4433-48bb-9b75-5833ceb0e448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:19.083214 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a273ef5-4433-48bb-9b75-5833ceb0e448 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:19.164814 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2888b8-ff38-4c79-a46c-2358348419db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:19.165436 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2888b8-ff38-4c79-a46c-2358348419db service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:19.165729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2888b8-ff38-4c79-a46c-2358348419db service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:19.165997 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2888b8-ff38-4c79-a46c-2358348419db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:19.167671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-8f2888b8-ff38-4c79-a46c-2358348419db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:19.175223 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:19.283616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2888b8-ff38-4c79-a46c-2358348419db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:19.285068 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2888b8-ff38-4c79-a46c-2358348419db service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:19.303554 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 670/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:22.115052 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f82267-db98-4ef0-9118-271cbe586050 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:22.115601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f82267-db98-4ef0-9118-271cbe586050 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:22.115601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f82267-db98-4ef0-9118-271cbe586050 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:22.116850 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 653/1323] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:22.122189 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcf36f-46ca-4325-ac3c-b8300dfada5b None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:22.122646 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcf36f-46ca-4325-ac3c-b8300dfada5b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:22.122740 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcf36f-46ca-4325-ac3c-b8300dfada5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:22.190612 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-f7fcf36f-46ca-4325-ac3c-b8300dfada5b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:22.191808 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-f7fcf36f-46ca-4325-ac3c-b8300dfada5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:22.259487 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:22.302032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 671/1324] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:22.576780 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f82267-db98-4ef0-9118-271cbe586050 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:22.578653 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d5f82267-db98-4ef0-9118-271cbe586050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:22.687077 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f82267-db98-4ef0-9118-271cbe586050 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:22.701834 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:22.764661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84756a9-e02e-4050-8bf0-52256576795c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:22.765315 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84756a9-e02e-4050-8bf0-52256576795c service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:22.765589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84756a9-e02e-4050-8bf0-52256576795c service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:22.765853 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84756a9-e02e-4050-8bf0-52256576795c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:22.767407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c84756a9-e02e-4050-8bf0-52256576795c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:22.880636 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84756a9-e02e-4050-8bf0-52256576795c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:22.881999 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84756a9-e02e-4050-8bf0-52256576795c service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:22.900192 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 654/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:25.111540 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c349b-a224-491b-a31c-1205e373ec8c None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:25.112095 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c349b-a224-491b-a31c-1205e373ec8c None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:25.112095 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c349b-a224-491b-a31c-1205e373ec8c None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:25.113428 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 672/1326] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:25.118955 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba779f-431d-48f7-b12f-c9ba9ee1fabc None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:25.119445 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba779f-431d-48f7-b12f-c9ba9ee1fabc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:25.119445 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba779f-431d-48f7-b12f-c9ba9ee1fabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:25.169370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:25.188607 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-24ba779f-431d-48f7-b12f-c9ba9ee1fabc None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:25.189807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-24ba779f-431d-48f7-b12f-c9ba9ee1fabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:25.298741 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 655/1327] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:25.574120 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c349b-a224-491b-a31c-1205e373ec8c None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:25.575719 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-0a2c349b-a224-491b-a31c-1205e373ec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:25.681855 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c349b-a224-491b-a31c-1205e373ec8c None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:25.756304 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e148f31-f3f6-47f3-a4b1-5df085c0341b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:25.756915 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e148f31-f3f6-47f3-a4b1-5df085c0341b service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:25.757189 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e148f31-f3f6-47f3-a4b1-5df085c0341b service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:25.757412 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e148f31-f3f6-47f3-a4b1-5df085c0341b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:25.759018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3e148f31-f3f6-47f3-a4b1-5df085c0341b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:25.776581 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:25.874587 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e148f31-f3f6-47f3-a4b1-5df085c0341b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:25.876190 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e148f31-f3f6-47f3-a4b1-5df085c0341b service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:25.894538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 673/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:28.100498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae71e6-b4ac-4d61-abfa-9653b7f4825c None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:28.101070 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae71e6-b4ac-4d61-abfa-9653b7f4825c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:28.101070 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae71e6-b4ac-4d61-abfa-9653b7f4825c None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:28.102884 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 656/1329] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:28.108131 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73bab2-50e8-4566-a6f5-b3c071f4b9ea None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:28.108554 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73bab2-50e8-4566-a6f5-b3c071f4b9ea None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:28.108795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73bab2-50e8-4566-a6f5-b3c071f4b9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:28.181023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-4d73bab2-50e8-4566-a6f5-b3c071f4b9ea None None] MFA Rules not processed for user `6f02ba7b97474cd7bb2e02b3f9f8106e`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:28.182145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-4d73bab2-50e8-4566-a6f5-b3c071f4b9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:28.263464 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:28.295727 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 674/1330] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:28.580678 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae71e6-b4ac-4d61-abfa-9653b7f4825c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:28.582221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f4ae71e6-b4ac-4d61-abfa-9653b7f4825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:28.687647 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae71e6-b4ac-4d61-abfa-9653b7f4825c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:28.709870 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:28.766110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534cebf-b278-4b5a-948f-8aee890bc08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:28.766722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534cebf-b278-4b5a-948f-8aee890bc08f service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:28.766995 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534cebf-b278-4b5a-948f-8aee890bc08f service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:28.767262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534cebf-b278-4b5a-948f-8aee890bc08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:28.771409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f534cebf-b278-4b5a-948f-8aee890bc08f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:28.885340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534cebf-b278-4b5a-948f-8aee890bc08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:28.886710 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534cebf-b278-4b5a-948f-8aee890bc08f service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:28.906203 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 657/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:28 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:31.271486 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db304a7-ad9a-4c53-b4cc-634f0c393304 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:31.272069 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db304a7-ad9a-4c53-b4cc-634f0c393304 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:31.272069 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db304a7-ad9a-4c53-b4cc-634f0c393304 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:31.273411 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 675/1332] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:31.279843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2198696-524c-457c-bb2f-6233b53c432d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:31.280943 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2198696-524c-457c-bb2f-6233b53c432d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:31.280943 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2198696-524c-457c-bb2f-6233b53c432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:31.349688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:31.353705 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-e2198696-524c-457c-bb2f-6233b53c432d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:31.355370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e2198696-524c-457c-bb2f-6233b53c432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:31.458230 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 658/1333] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:31.735528 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db304a7-ad9a-4c53-b4cc-634f0c393304 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:31.737101 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-1db304a7-ad9a-4c53-b4cc-634f0c393304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:31.858029 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db304a7-ad9a-4c53-b4cc-634f0c393304 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:31.935692 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6b307-964a-463b-8897-3730cca22971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:31.936406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6b307-964a-463b-8897-3730cca22971 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:31.936677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6b307-964a-463b-8897-3730cca22971 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:31.937033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6b307-964a-463b-8897-3730cca22971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:31.938654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-47b6b307-964a-463b-8897-3730cca22971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:31.965862 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:32.059953 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6b307-964a-463b-8897-3730cca22971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:32.061426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6b307-964a-463b-8897-3730cca22971 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:32.082142 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 676/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:34.224263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23497c-0f56-4138-aa4d-9cbbee4de48e None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:34.224821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23497c-0f56-4138-aa4d-9cbbee4de48e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:34.224821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23497c-0f56-4138-aa4d-9cbbee4de48e None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:34.226118 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 659/1335] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:34.232464 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a9297-80fc-4fbd-8d2d-18094daf3de4 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:34.233145 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a9297-80fc-4fbd-8d2d-18094daf3de4 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:34.233358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a9297-80fc-4fbd-8d2d-18094daf3de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:34.310887 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-d32a9297-80fc-4fbd-8d2d-18094daf3de4 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:34.312211 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-d32a9297-80fc-4fbd-8d2d-18094daf3de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:34.408416 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:34.431820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 677/1336] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:34.713700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23497c-0f56-4138-aa4d-9cbbee4de48e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:34.715222 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-bb23497c-0f56-4138-aa4d-9cbbee4de48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:34.825996 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23497c-0f56-4138-aa4d-9cbbee4de48e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:34.854487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:34.903032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bccb9e-b22e-4b53-9265-f8629e3a2d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:34.903619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bccb9e-b22e-4b53-9265-f8629e3a2d06 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:34.903887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bccb9e-b22e-4b53-9265-f8629e3a2d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:34.904184 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bccb9e-b22e-4b53-9265-f8629e3a2d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:34.905828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-01bccb9e-b22e-4b53-9265-f8629e3a2d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:35.022012 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bccb9e-b22e-4b53-9265-f8629e3a2d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:35.023452 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bccb9e-b22e-4b53-9265-f8629e3a2d06 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:35.042188 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 660/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:48:37.541977 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aba36-f984-4da2-b243-c2811cfa03f2 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:37.542624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aba36-f984-4da2-b243-c2811cfa03f2 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:37.542624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aba36-f984-4da2-b243-c2811cfa03f2 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:37.543852 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 678/1338] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:37.549999 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0331165-91ca-431f-8ec1-2311a2cf76e1 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:37.550718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0331165-91ca-431f-8ec1-2311a2cf76e1 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:37.550849 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0331165-91ca-431f-8ec1-2311a2cf76e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:37.628152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d0331165-91ca-431f-8ec1-2311a2cf76e1 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:37.629340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d0331165-91ca-431f-8ec1-2311a2cf76e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:37.637610 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:37.730170 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 661/1339] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:38.009904 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aba36-f984-4da2-b243-c2811cfa03f2 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:38.012474 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-dc8aba36-f984-4da2-b243-c2811cfa03f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:38.139922 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aba36-f984-4da2-b243-c2811cfa03f2 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:38.215322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de5c1b-db50-4213-b07b-200aa9ea628f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:38.215925 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de5c1b-db50-4213-b07b-200aa9ea628f service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:38.216222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de5c1b-db50-4213-b07b-200aa9ea628f service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:38.216507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de5c1b-db50-4213-b07b-200aa9ea628f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:38.218239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-50de5c1b-db50-4213-b07b-200aa9ea628f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:38.255709 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:38.340321 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de5c1b-db50-4213-b07b-200aa9ea628f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:38.342042 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de5c1b-db50-4213-b07b-200aa9ea628f service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:38.361545 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 679/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:42.510490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7c4a6-72b1-4bf4-8b43-de5ad511d65c None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:42.511105 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7c4a6-72b1-4bf4-8b43-de5ad511d65c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:42.511105 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7c4a6-72b1-4bf4-8b43-de5ad511d65c None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:42.512441 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 662/1341] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:42.518296 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c0774-cf11-467a-9c48-0a1e4bc4f596 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:42.518744 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c0774-cf11-467a-9c48-0a1e4bc4f596 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:42.518841 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c0774-cf11-467a-9c48-0a1e4bc4f596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:42.589301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-fd6c0774-cf11-467a-9c48-0a1e4bc4f596 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:42.590460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-fd6c0774-cf11-467a-9c48-0a1e4bc4f596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:42.680864 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:42.692682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 680/1342] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:42.978356 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7c4a6-72b1-4bf4-8b43-de5ad511d65c None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:42.979883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-03d7c4a6-72b1-4bf4-8b43-de5ad511d65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:43.088344 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7c4a6-72b1-4bf4-8b43-de5ad511d65c None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:43.127807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:43.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b220e-6e57-4924-aed9-c04b84ecd6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:43.166129 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b220e-6e57-4924-aed9-c04b84ecd6ce service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:43.166405 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b220e-6e57-4924-aed9-c04b84ecd6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:43.166673 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b220e-6e57-4924-aed9-c04b84ecd6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:43.168325 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8e2b220e-6e57-4924-aed9-c04b84ecd6ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:43.278980 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b220e-6e57-4924-aed9-c04b84ecd6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:43.280684 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b220e-6e57-4924-aed9-c04b84ecd6ce service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:43.300137 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 663/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:46.232097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec47ca-239a-4aa5-944f-c2be2b7dbffb None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:46.232653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec47ca-239a-4aa5-944f-c2be2b7dbffb None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:46.232653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec47ca-239a-4aa5-944f-c2be2b7dbffb None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:46.234032 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 681/1344] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:46.239363 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392efed-173d-4032-b563-a99a6ab567a5 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:46.239854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392efed-173d-4032-b563-a99a6ab567a5 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:46.239957 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392efed-173d-4032-b563-a99a6ab567a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:46.314745 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0392efed-173d-4032-b563-a99a6ab567a5 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:46.315962 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0392efed-173d-4032-b563-a99a6ab567a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:46.334730 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:46.416566 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 664/1345] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:46.698562 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec47ca-239a-4aa5-944f-c2be2b7dbffb None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:46.700063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-0cec47ca-239a-4aa5-944f-c2be2b7dbffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:46.808629 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec47ca-239a-4aa5-944f-c2be2b7dbffb None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:46.884327 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc040ef3-0a32-4eef-b8af-64856b9c96e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:46.884932 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc040ef3-0a32-4eef-b8af-64856b9c96e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:46.885204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc040ef3-0a32-4eef-b8af-64856b9c96e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:46.885471 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc040ef3-0a32-4eef-b8af-64856b9c96e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:46.887041 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-cc040ef3-0a32-4eef-b8af-64856b9c96e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:46.948691 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:47.023706 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc040ef3-0a32-4eef-b8af-64856b9c96e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:47.025427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc040ef3-0a32-4eef-b8af-64856b9c96e3 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:47.044592 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 682/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:51.485100 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159667-dbdc-4c3c-893a-45f19142c509 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:51.485637 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159667-dbdc-4c3c-893a-45f19142c509 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:51.485637 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159667-dbdc-4c3c-893a-45f19142c509 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:51.487006 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 665/1347] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:51.493409 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad98f9-2a71-4fa0-a3c6-d583553f8fc2 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:51.493846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad98f9-2a71-4fa0-a3c6-d583553f8fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:51.493846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad98f9-2a71-4fa0-a3c6-d583553f8fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:51.574528 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-0cad98f9-2a71-4fa0-a3c6-d583553f8fc2 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:51.575787 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-0cad98f9-2a71-4fa0-a3c6-d583553f8fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:51.682479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:51.685823 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 683/1348] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:51.975817 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8159667-dbdc-4c3c-893a-45f19142c509 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:51.978280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b8159667-dbdc-4c3c-893a-45f19142c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:52.089584 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8159667-dbdc-4c3c-893a-45f19142c509 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:52.139923 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:52.171040 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e4fa4-0774-4061-bee9-6c6cb2ea14d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:52.171637 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4fa4-0774-4061-bee9-6c6cb2ea14d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:52.171905 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4fa4-0774-4061-bee9-6c6cb2ea14d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:52.172210 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4fa4-0774-4061-bee9-6c6cb2ea14d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:52.173764 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8a3e4fa4-0774-4061-bee9-6c6cb2ea14d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:52.280959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e4fa4-0774-4061-bee9-6c6cb2ea14d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:52.282407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e4fa4-0774-4061-bee9-6c6cb2ea14d3 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:52.300588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 666/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:57.248336 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e2e6e-c27c-4853-90aa-ea961d3f5abe None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:57.249372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e2e6e-c27c-4853-90aa-ea961d3f5abe None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:57.249372 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e2e6e-c27c-4853-90aa-ea961d3f5abe None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:57.250523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 684/1350] 10.222.0.43 () {54 vars in 921 bytes} [Sun Oct 9 00:48:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:57.256460 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80625277-95c9-4df8-9b00-d186dac5f24c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:57.256870 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80625277-95c9-4df8-9b00-d186dac5f24c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:57.257054 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80625277-95c9-4df8-9b00-d186dac5f24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:57.384072 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-80625277-95c9-4df8-9b00-d186dac5f24c None None] MFA Rules not processed for user `536ebcc364834a75beefab0f2b0cc196`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:57.385717 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-80625277-95c9-4df8-9b00-d186dac5f24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:57.405743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:57.536517 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 667/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Oct 9 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:01.505565 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5df68-8a1b-46c2-baf6-5b7c80d830a9 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:01.506547 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5df68-8a1b-46c2-baf6-5b7c80d830a9 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:01.506920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5df68-8a1b-46c2-baf6-5b7c80d830a9 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:01.508502 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 685/1352] 10.222.0.43 () {54 vars in 921 bytes} [Sun Oct 9 00:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:01.513476 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf142e4-24f8-4695-be6c-8b0aa3632d74 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:01.513889 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf142e4-24f8-4695-be6c-8b0aa3632d74 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:01.514129 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf142e4-24f8-4695-be6c-8b0aa3632d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:01.594044 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-dcf142e4-24f8-4695-be6c-8b0aa3632d74 None None] MFA Rules not processed for user `536ebcc364834a75beefab0f2b0cc196`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:01.595249 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-dcf142e4-24f8-4695-be6c-8b0aa3632d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:01.672557 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:01.712007 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 668/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Oct 9 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:03.163222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda322a-7d86-4b90-bba1-27dd09675900 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:03.164011 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda322a-7d86-4b90-bba1-27dd09675900 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:03.164011 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda322a-7d86-4b90-bba1-27dd09675900 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:03.165043 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 686/1354] 10.222.0.43 () {54 vars in 921 bytes} [Sun Oct 9 00:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:03.170770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23392e-7d10-4aca-a8d7-f6aca93e1dae None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:03.171479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23392e-7d10-4aca-a8d7-f6aca93e1dae None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:03.171479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23392e-7d10-4aca-a8d7-f6aca93e1dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:03.260903 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0a23392e-7d10-4aca-a8d7-f6aca93e1dae None None] MFA Rules not processed for user `536ebcc364834a75beefab0f2b0cc196`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:03.262120 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0a23392e-7d10-4aca-a8d7-f6aca93e1dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:03.379897 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 669/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Oct 9 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:49:06.906362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1613bf5-a6ec-464f-b93a-52cc36875c83 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:06.907793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1613bf5-a6ec-464f-b93a-52cc36875c83 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:06.908155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1613bf5-a6ec-464f-b93a-52cc36875c83 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:06.909490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 687/1356] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:06.915362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436366fb-1140-478e-8cbc-a559b63a61a4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:06.915856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436366fb-1140-478e-8cbc-a559b63a61a4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:06.915967 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436366fb-1140-478e-8cbc-a559b63a61a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:06.956496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:06.990663 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-436366fb-1140-478e-8cbc-a559b63a61a4 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:06.991888 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-436366fb-1140-478e-8cbc-a559b63a61a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:07.093518 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 670/1357] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:07.400467 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8f731-96ff-4761-b3e8-613984157eaf None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:07.401027 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8f731-96ff-4761-b3e8-613984157eaf None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:07.401510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8f731-96ff-4761-b3e8-613984157eaf None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:07.403601 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 688/1358] 10.222.0.43 () {54 vars in 961 bytes} [Sun Oct 9 00:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:07.409921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e2e34-c6b6-40fe-bb1c-176f8fd1675e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:07.410208 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e2e34-c6b6-40fe-bb1c-176f8fd1675e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:07.410491 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e2e34-c6b6-40fe-bb1c-176f8fd1675e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:07.508292 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-723e2e34-c6b6-40fe-bb1c-176f8fd1675e None None] MFA Rules not processed for user `f960fdabbffa4813a0ea46bb82218f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:07.509503 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-723e2e34-c6b6-40fe-bb1c-176f8fd1675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:07.569522 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:07.632691 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 671/1359] 10.222.0.43 () {58 vars in 1058 bytes} [Sun Oct 9 00:49:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:07.640868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8f731-96ff-4761-b3e8-613984157eaf None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:07.642398 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-bbc8f731-96ff-4761-b3e8-613984157eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:07.828950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8f731-96ff-4761-b3e8-613984157eaf None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:07.910410 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:07.956783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6085a-bbf0-4f4c-9ba7-82c92aae054a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:07.957395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6085a-bbf0-4f4c-9ba7-82c92aae054a service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:07.957698 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6085a-bbf0-4f4c-9ba7-82c92aae054a service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:07.957927 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6085a-bbf0-4f4c-9ba7-82c92aae054a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:07.960194 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-43b6085a-bbf0-4f4c-9ba7-82c92aae054a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:08.057782 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6085a-bbf0-4f4c-9ba7-82c92aae054a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:08.059477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6085a-bbf0-4f4c-9ba7-82c92aae054a service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:08.080842 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 689/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:10.419369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbdc48-3cd0-49b5-8f2b-4a6c39a73fa4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:10.419369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbdc48-3cd0-49b5-8f2b-4a6c39a73fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:10.420205 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbdc48-3cd0-49b5-8f2b-4a6c39a73fa4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:10.424987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 672/1361] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:10.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695401a9-1ecd-45c3-b938-c74e374131a9 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:10.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695401a9-1ecd-45c3-b938-c74e374131a9 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:10.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695401a9-1ecd-45c3-b938-c74e374131a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:10.497677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-695401a9-1ecd-45c3-b938-c74e374131a9 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:10.499201 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-695401a9-1ecd-45c3-b938-c74e374131a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:10.540116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:10.602515 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 690/1362] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:49:10.895317 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbdc48-3cd0-49b5-8f2b-4a6c39a73fa4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:10.896985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1ccbdc48-3cd0-49b5-8f2b-4a6c39a73fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:11.085685 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbdc48-3cd0-49b5-8f2b-4a6c39a73fa4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:11.098368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:11.229480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe769ef-7288-4fcb-aa73-b2689fbcb2f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:11.230089 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe769ef-7288-4fcb-aa73-b2689fbcb2f2 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:11.230347 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe769ef-7288-4fcb-aa73-b2689fbcb2f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:11.230617 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe769ef-7288-4fcb-aa73-b2689fbcb2f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:11.232232 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cfe769ef-7288-4fcb-aa73-b2689fbcb2f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:11.325495 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe769ef-7288-4fcb-aa73-b2689fbcb2f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:11.327197 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe769ef-7288-4fcb-aa73-b2689fbcb2f2 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:11.345589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 673/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:13.792538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8d8f-6e9b-40b8-b819-71110a720ffa None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:13.793077 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8d8f-6e9b-40b8-b819-71110a720ffa None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:13.793077 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8d8f-6e9b-40b8-b819-71110a720ffa None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:13.794654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 691/1364] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:13.800424 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b0af-1293-4f46-b159-8bc54d2e80ad None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:13.800882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b0af-1293-4f46-b159-8bc54d2e80ad None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:13.800974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b0af-1293-4f46-b159-8bc54d2e80ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:13.816480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:13.871688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-cfb3b0af-1293-4f46-b159-8bc54d2e80ad None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:13.873019 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cfb3b0af-1293-4f46-b159-8bc54d2e80ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:13.979659 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 674/1365] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:14.266770 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9acb33-539c-4172-af2f-7c6ade826d9b None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:14.267120 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9acb33-539c-4172-af2f-7c6ade826d9b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:14.267461 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9acb33-539c-4172-af2f-7c6ade826d9b None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:14.269066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 692/1366] 10.222.0.43 () {54 vars in 961 bytes} [Sun Oct 9 00:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:14.275162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2be34d-c851-401d-976b-852b921b0cb3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:14.275506 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2be34d-c851-401d-976b-852b921b0cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:14.275840 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2be34d-c851-401d-976b-852b921b0cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:14.354449 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8c2be34d-c851-401d-976b-852b921b0cb3 None None] MFA Rules not processed for user `f960fdabbffa4813a0ea46bb82218f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:14.355624 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8c2be34d-c851-401d-976b-852b921b0cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:14.391868 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:14.478726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 675/1367] 10.222.0.43 () {58 vars in 1058 bytes} [Sun Oct 9 00:49:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:14.486422 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9acb33-539c-4172-af2f-7c6ade826d9b None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:14.487931 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-1e9acb33-539c-4172-af2f-7c6ade826d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:14.648889 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9acb33-539c-4172-af2f-7c6ade826d9b None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:14.670482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:14.774149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae14290-1b01-4ef0-95ba-bbd246baf9a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:14.774763 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae14290-1b01-4ef0-95ba-bbd246baf9a3 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:14.775033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae14290-1b01-4ef0-95ba-bbd246baf9a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:14.775297 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae14290-1b01-4ef0-95ba-bbd246baf9a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:14.777060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-6ae14290-1b01-4ef0-95ba-bbd246baf9a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:14.884152 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae14290-1b01-4ef0-95ba-bbd246baf9a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:14.886914 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae14290-1b01-4ef0-95ba-bbd246baf9a3 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:14.908844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 693/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:49:15.003887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e65a6a-9b2c-4acc-8ad3-21e42576652f None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:15.004455 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e65a6a-9b2c-4acc-8ad3-21e42576652f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:15.004455 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e65a6a-9b2c-4acc-8ad3-21e42576652f None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:15.005880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 676/1369] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:15.013773 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414677e-759a-4ccb-bda7-f8b0a32b279a None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:15.014255 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414677e-759a-4ccb-bda7-f8b0a32b279a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:15.014531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414677e-759a-4ccb-bda7-f8b0a32b279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:15.055218 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:15.102136 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-0414677e-759a-4ccb-bda7-f8b0a32b279a None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:15.103734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-0414677e-759a-4ccb-bda7-f8b0a32b279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:15.224081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 694/1370] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:49:15.556665 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89a74f-ea4a-4e18-823b-189bb641674a None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:15.556942 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89a74f-ea4a-4e18-823b-189bb641674a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:15.558104 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89a74f-ea4a-4e18-823b-189bb641674a None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:15.558648 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 677/1371] 10.222.0.43 () {54 vars in 963 bytes} [Sun Oct 9 00:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:15.563713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453486a6-1406-468c-913d-500e85946b41 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:15.563968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453486a6-1406-468c-913d-500e85946b41 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:15.564272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453486a6-1406-468c-913d-500e85946b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:15.646501 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-453486a6-1406-468c-913d-500e85946b41 None None] MFA Rules not processed for user `a44cd61c1bfd4ed29e7ede8f8e3a22be`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:15.647716 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-453486a6-1406-468c-913d-500e85946b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:15.698845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:15.731580 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 695/1372] 10.222.0.43 () {58 vars in 1060 bytes} [Sun Oct 9 00:49:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:15.739137 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89a74f-ea4a-4e18-823b-189bb641674a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:15.740696 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1f89a74f-ea4a-4e18-823b-189bb641674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:15.868605 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89a74f-ea4a-4e18-823b-189bb641674a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:15.919689 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:15.965066 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c1c24-404d-4ff6-9a28-6e45dcab2a38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44cd61c1bfd4ed29e7ede8f8e3a22be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:15.965906 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c1c24-404d-4ff6-9a28-6e45dcab2a38 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:15.966307 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c1c24-404d-4ff6-9a28-6e45dcab2a38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:15.966729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c1c24-404d-4ff6-9a28-6e45dcab2a38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:15.968651 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ff4c1c24-404d-4ff6-9a28-6e45dcab2a38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:16.102577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c1c24-404d-4ff6-9a28-6e45dcab2a38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:16.104240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c1c24-404d-4ff6-9a28-6e45dcab2a38 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:16.122436 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 678/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:17.139227 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f41888-b140-4e7d-8283-9227552ab2f0 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:17.140006 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f41888-b140-4e7d-8283-9227552ab2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:17.140006 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f41888-b140-4e7d-8283-9227552ab2f0 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:17.141183 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 696/1374] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:17.146978 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a16b-a7b7-4cc1-954c-7488c408c467 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:17.147486 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a16b-a7b7-4cc1-954c-7488c408c467 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:17.147486 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a16b-a7b7-4cc1-954c-7488c408c467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:17.217039 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f101a16b-a7b7-4cc1-954c-7488c408c467 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:17.218534 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f101a16b-a7b7-4cc1-954c-7488c408c467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:17.241829 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:17.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 679/1375] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:17.605892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f41888-b140-4e7d-8283-9227552ab2f0 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:17.607687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-a9f41888-b140-4e7d-8283-9227552ab2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:17.776618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f41888-b140-4e7d-8283-9227552ab2f0 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:17.836681 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:17.901226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e9c5f-62d1-4f44-8e3f-9092b3302441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:17.901850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9c5f-62d1-4f44-8e3f-9092b3302441 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:17.902127 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9c5f-62d1-4f44-8e3f-9092b3302441 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:17.902392 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9c5f-62d1-4f44-8e3f-9092b3302441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:17.903975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-ae5e9c5f-62d1-4f44-8e3f-9092b3302441 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:17.995317 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e9c5f-62d1-4f44-8e3f-9092b3302441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:17.997342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e9c5f-62d1-4f44-8e3f-9092b3302441 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:18.016187 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 697/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:20.215406 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09609b8-9e64-4409-b4a7-bd8c67f26ee6 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:20.215963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09609b8-9e64-4409-b4a7-bd8c67f26ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:20.215963 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09609b8-9e64-4409-b4a7-bd8c67f26ee6 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:20.217281 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 680/1377] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:20.222784 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3c51e-3b28-4f05-89cd-6f4c9497126a None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:20.223589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3c51e-3b28-4f05-89cd-6f4c9497126a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:20.223837 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3c51e-3b28-4f05-89cd-6f4c9497126a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:20.293230 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-06f3c51e-3b28-4f05-89cd-6f4c9497126a None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:20.294621 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-06f3c51e-3b28-4f05-89cd-6f4c9497126a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:20.302592 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:20.403120 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 698/1378] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:20.692792 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09609b8-9e64-4409-b4a7-bd8c67f26ee6 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:20.694438 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a09609b8-9e64-4409-b4a7-bd8c67f26ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:20.860259 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09609b8-9e64-4409-b4a7-bd8c67f26ee6 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:20.864266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:20.984770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8289f-24a0-4ddd-a45b-1f2e427905fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:20.985380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8289f-24a0-4ddd-a45b-1f2e427905fe service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:20.985639 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8289f-24a0-4ddd-a45b-1f2e427905fe service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:20.985917 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8289f-24a0-4ddd-a45b-1f2e427905fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:20.987498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8ac8289f-24a0-4ddd-a45b-1f2e427905fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:21.081508 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8289f-24a0-4ddd-a45b-1f2e427905fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:21.083108 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8289f-24a0-4ddd-a45b-1f2e427905fe service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:21.101882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 681/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:23.294592 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85374a8c-e89b-4ebd-860c-83ab7d5ae264 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:23.295213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85374a8c-e89b-4ebd-860c-83ab7d5ae264 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:23.295213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85374a8c-e89b-4ebd-860c-83ab7d5ae264 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:23.296769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 699/1380] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:23.301858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a6b37-ab0d-449a-9ef1-8254b16f38b7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:23.302320 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a6b37-ab0d-449a-9ef1-8254b16f38b7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:23.302404 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a6b37-ab0d-449a-9ef1-8254b16f38b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:23.313855 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:23.372784 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f92a6b37-ab0d-449a-9ef1-8254b16f38b7 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:23.374135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f92a6b37-ab0d-449a-9ef1-8254b16f38b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:23.499403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 682/1381] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:23.789611 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85374a8c-e89b-4ebd-860c-83ab7d5ae264 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:23.791312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-85374a8c-e89b-4ebd-860c-83ab7d5ae264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:23.940700 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:23.954113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85374a8c-e89b-4ebd-860c-83ab7d5ae264 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:24.077444 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e7965-0538-4c98-9f96-9cccdee3c95d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:24.078071 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e7965-0538-4c98-9f96-9cccdee3c95d service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:24.078354 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e7965-0538-4c98-9f96-9cccdee3c95d service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:24.078618 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e7965-0538-4c98-9f96-9cccdee3c95d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:24.080242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-938e7965-0538-4c98-9f96-9cccdee3c95d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:24.182805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e7965-0538-4c98-9f96-9cccdee3c95d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:24.184610 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e7965-0538-4c98-9f96-9cccdee3c95d service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:24.196159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:24.205566 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 700/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:26.394496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08c2d6-6263-45ff-905c-4e108b4f5aaf None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:26.395101 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08c2d6-6263-45ff-905c-4e108b4f5aaf None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:26.395101 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08c2d6-6263-45ff-905c-4e108b4f5aaf None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:26.396615 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 683/1383] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:26.401774 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5bf8b-e5d4-4e20-829d-65f17e9cff8b None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:26.402274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5bf8b-e5d4-4e20-829d-65f17e9cff8b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:26.402274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5bf8b-e5d4-4e20-829d-65f17e9cff8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:26.467596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-27c5bf8b-e5d4-4e20-829d-65f17e9cff8b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:26.468811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-27c5bf8b-e5d4-4e20-829d-65f17e9cff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:26.571829 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 701/1384] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:49:26.865240 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08c2d6-6263-45ff-905c-4e108b4f5aaf None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:26.866762 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5d08c2d6-6263-45ff-905c-4e108b4f5aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:26.954706 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:27.017020 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08c2d6-6263-45ff-905c-4e108b4f5aaf None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:27.144150 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6f06d-2508-40bb-9bff-4f11bfd23065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:27.144708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6f06d-2508-40bb-9bff-4f11bfd23065 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:27.144984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6f06d-2508-40bb-9bff-4f11bfd23065 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:27.145253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6f06d-2508-40bb-9bff-4f11bfd23065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:27.146833 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1fb6f06d-2508-40bb-9bff-4f11bfd23065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:27.197440 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:27.240854 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6f06d-2508-40bb-9bff-4f11bfd23065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:27.242467 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6f06d-2508-40bb-9bff-4f11bfd23065 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:27.260881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 684/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:29.395791 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20861dc8-d4fa-4f4f-80ff-7901b7691d23 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:29.396371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20861dc8-d4fa-4f4f-80ff-7901b7691d23 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:29.396635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20861dc8-d4fa-4f4f-80ff-7901b7691d23 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:29.398368 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 702/1386] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:29.404125 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c300b-2b54-4b64-a031-78aacfe0568e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:29.404552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c300b-2b54-4b64-a031-78aacfe0568e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:29.404761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c300b-2b54-4b64-a031-78aacfe0568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:29.476103 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-198c300b-2b54-4b64-a031-78aacfe0568e None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:29.477330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-198c300b-2b54-4b64-a031-78aacfe0568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:29.580547 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 685/1387] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:29.910390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20861dc8-d4fa-4f4f-80ff-7901b7691d23 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:29.911975 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-20861dc8-d4fa-4f4f-80ff-7901b7691d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:29.993609 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:30.069146 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20861dc8-d4fa-4f4f-80ff-7901b7691d23 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:30.197015 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7c923-d391-4b0d-b94d-808fcafc6176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:30.197616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c923-d391-4b0d-b94d-808fcafc6176 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:30.197884 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c923-d391-4b0d-b94d-808fcafc6176 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:30.198143 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c923-d391-4b0d-b94d-808fcafc6176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:30.200177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-8eb7c923-d391-4b0d-b94d-808fcafc6176 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:30.243809 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:30.300875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7c923-d391-4b0d-b94d-808fcafc6176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:30.302895 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7c923-d391-4b0d-b94d-808fcafc6176 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:30.323149 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 703/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:32.914911 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1de17-57f4-4f31-9c84-776449533fea None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:32.915630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1de17-57f4-4f31-9c84-776449533fea None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:32.915630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1de17-57f4-4f31-9c84-776449533fea None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:32.917098 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 686/1389] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:32.923857 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0a9e-b0c1-46cf-af48-c5e660ecd142 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:32.924488 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0a9e-b0c1-46cf-af48-c5e660ecd142 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:32.924741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0a9e-b0c1-46cf-af48-c5e660ecd142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:32.995453 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-1bea0a9e-b0c1-46cf-af48-c5e660ecd142 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:32.997007 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-1bea0a9e-b0c1-46cf-af48-c5e660ecd142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:33.110547 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 704/1390] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:33.393971 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1de17-57f4-4f31-9c84-776449533fea None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:33.395539 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b0c1de17-57f4-4f31-9c84-776449533fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:33.429839 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:33.564057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1de17-57f4-4f31-9c84-776449533fea None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:33.673695 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:33.688742 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ffae1-494d-4b2d-8178-f810f7593d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:33.689572 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ffae1-494d-4b2d-8178-f810f7593d4d service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:33.689914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ffae1-494d-4b2d-8178-f810f7593d4d service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:33.690253 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ffae1-494d-4b2d-8178-f810f7593d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:33.692345 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cc2ffae1-494d-4b2d-8178-f810f7593d4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:33.797858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ffae1-494d-4b2d-8178-f810f7593d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:33.799656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ffae1-494d-4b2d-8178-f810f7593d4d service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:33.820745 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 687/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:35.996835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4748a8-664e-48e1-8225-d383c2ca2643 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:35.997403 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4748a8-664e-48e1-8225-d383c2ca2643 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:35.997403 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4748a8-664e-48e1-8225-d383c2ca2643 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:35.998840 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 705/1392] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:36.004640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056cdd9-6d0b-427c-9d47-1203ff2520a4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:36.005098 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056cdd9-6d0b-427c-9d47-1203ff2520a4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:36.005190 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056cdd9-6d0b-427c-9d47-1203ff2520a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:36.072583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1056cdd9-6d0b-427c-9d47-1203ff2520a4 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:36.073694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1056cdd9-6d0b-427c-9d47-1203ff2520a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:36.134474 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:36.175483 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 688/1393] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:36.465293 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4748a8-664e-48e1-8225-d383c2ca2643 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:36.467276 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-db4748a8-664e-48e1-8225-d383c2ca2643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:36.479619 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baea8bb-7f62-4c18-8583-5a638c14eb27 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:36.480033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baea8bb-7f62-4c18-8583-5a638c14eb27 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:36.480335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baea8bb-7f62-4c18-8583-5a638c14eb27 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:36.481740 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 689/1394] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:36.482775 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:36.487280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2c21-3471-4121-81d8-dd79bac36e23 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:36.487798 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2c21-3471-4121-81d8-dd79bac36e23 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:36.488090 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2c21-3471-4121-81d8-dd79bac36e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:36.556494 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-6c8b2c21-3471-4121-81d8-dd79bac36e23 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:36.557734 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-6c8b2c21-3471-4121-81d8-dd79bac36e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:36.619847 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4748a8-664e-48e1-8225-d383c2ca2643 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:36.658872 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 690/1395] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:49:36.708222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:36.739199 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef918-9ec8-4fb9-ad89-f01cc8938b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:36.739820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef918-9ec8-4fb9-ad89-f01cc8938b1d service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:36.740113 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef918-9ec8-4fb9-ad89-f01cc8938b1d service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:36.740381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef918-9ec8-4fb9-ad89-f01cc8938b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:36.741945 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3acef918-9ec8-4fb9-ad89-f01cc8938b1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:36.836529 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acef918-9ec8-4fb9-ad89-f01cc8938b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:36.838253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acef918-9ec8-4fb9-ad89-f01cc8938b1d service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:36.856945 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 706/1396] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:36.964453 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2a498-aa95-4d17-a605-e57cce1ca5c3 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:36.964656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2a498-aa95-4d17-a605-e57cce1ca5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:36.964901 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2a498-aa95-4d17-a605-e57cce1ca5c3 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:36.966277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 691/1397] 10.222.0.43 () {54 vars in 962 bytes} [Sun Oct 9 00:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:36.972277 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882321f8-5cc3-4d49-84c9-5fd0e0ba2d91 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:36.972840 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882321f8-5cc3-4d49-84c9-5fd0e0ba2d91 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:36.973116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882321f8-5cc3-4d49-84c9-5fd0e0ba2d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:37.086275 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-882321f8-5cc3-4d49-84c9-5fd0e0ba2d91 None None] MFA Rules not processed for user `dbbd529122d64e46a70f62e351b27fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:37.087504 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-882321f8-5cc3-4d49-84c9-5fd0e0ba2d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:37.133821 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:37.170709 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 707/1398] 10.222.0.43 () {58 vars in 1059 bytes} [Sun Oct 9 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:37.179900 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2a498-aa95-4d17-a605-e57cce1ca5c3 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:37.181454 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c9d2a498-aa95-4d17-a605-e57cce1ca5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:37.236463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:37.298032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2a498-aa95-4d17-a605-e57cce1ca5c3 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:37.380663 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bdbf9-67d4-4746-b9ec-30d031fe12ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbd529122d64e46a70f62e351b27fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:37.381266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bdbf9-67d4-4746-b9ec-30d031fe12ed service glance] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:37.381536 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bdbf9-67d4-4746-b9ec-30d031fe12ed service glance] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:37.381801 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bdbf9-67d4-4746-b9ec-30d031fe12ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:37.383365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1a3bdbf9-67d4-4746-b9ec-30d031fe12ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:37.481773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:37.499391 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bdbf9-67d4-4746-b9ec-30d031fe12ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:37.501186 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bdbf9-67d4-4746-b9ec-30d031fe12ed service glance] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:37.520079 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 692/1399] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:38.259172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefadbc6-f572-4e36-866b-8c07ab049bd2 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:38.259676 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefadbc6-f572-4e36-866b-8c07ab049bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:38.259916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefadbc6-f572-4e36-866b-8c07ab049bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:38.327492 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-cefadbc6-f572-4e36-866b-8c07ab049bd2 None None] MFA Rules not processed for user `7b36a416960d4106935476ef2b1682f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:38.328722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-cefadbc6-f572-4e36-866b-8c07ab049bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:38.420444 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 708/1400] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Oct 9 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:38.466448 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b54b7-2698-4562-81ee-8b56260ad3ec None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:38.467017 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b54b7-2698-4562-81ee-8b56260ad3ec None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:38.467017 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b54b7-2698-4562-81ee-8b56260ad3ec None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:38.468670 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 693/1401] 10.222.0.43 () {54 vars in 943 bytes} [Sun Oct 9 00:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:38.476481 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d96c4-91a6-4d37-b2cb-a29b2253206c None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:38.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d96c4-91a6-4d37-b2cb-a29b2253206c None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:38.477319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d96c4-91a6-4d37-b2cb-a29b2253206c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:38.548321 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:38.556589 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-de7d96c4-91a6-4d37-b2cb-a29b2253206c None None] MFA Rules not processed for user `cbc22a3976aa47cfb4367b0a433742ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:38.557795 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-de7d96c4-91a6-4d37-b2cb-a29b2253206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:38.666390 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 709/1402] 10.222.0.43 () {58 vars in 1040 bytes} [Sun Oct 9 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:38.676234 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b54b7-2698-4562-81ee-8b56260ad3ec None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:38.677743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-562b54b7-2698-4562-81ee-8b56260ad3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:38.822199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b54b7-2698-4562-81ee-8b56260ad3ec None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:38.885755 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:38.929964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d60f8d-4463-424d-9fb7-cf3052caef26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc22a3976aa47cfb4367b0a433742ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:38.930572 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60f8d-4463-424d-9fb7-cf3052caef26 service swift] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:38.930845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60f8d-4463-424d-9fb7-cf3052caef26 service swift] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:38.931110 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60f8d-4463-424d-9fb7-cf3052caef26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:38.932785 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-72d60f8d-4463-424d-9fb7-cf3052caef26 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:39.023019 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d60f8d-4463-424d-9fb7-cf3052caef26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:39.024616 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d60f8d-4463-424d-9fb7-cf3052caef26 service swift] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:39.033009 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 694/1403] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Oct 9 00:49:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:49:39.079292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cf1d7-ae53-4ed7-9370-6893ff15f275 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:39.079604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cf1d7-ae53-4ed7-9370-6893ff15f275 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:39.079841 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cf1d7-ae53-4ed7-9370-6893ff15f275 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:39.081232 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 710/1404] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:39.086708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbd258-ca24-4f1b-8966-b647a373da13 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:39.086983 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbd258-ca24-4f1b-8966-b647a373da13 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:39.087255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbd258-ca24-4f1b-8966-b647a373da13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:39.161624 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b8bbd258-ca24-4f1b-8966-b647a373da13 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:39.162872 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b8bbd258-ca24-4f1b-8966-b647a373da13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:39.220952 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:39.280225 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 695/1405] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:39.564413 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cf1d7-ae53-4ed7-9370-6893ff15f275 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:39.566107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-748cf1d7-ae53-4ed7-9370-6893ff15f275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:39.691547 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:39.730060 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cf1d7-ae53-4ed7-9370-6893ff15f275 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:39.872519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8582d6-02ec-40c1-a581-522a132fb3d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:39.873096 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8582d6-02ec-40c1-a581-522a132fb3d3 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:39.873380 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8582d6-02ec-40c1-a581-522a132fb3d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:39.873672 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8582d6-02ec-40c1-a581-522a132fb3d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:39.875559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-0c8582d6-02ec-40c1-a581-522a132fb3d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:39.961248 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:39.976581 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8582d6-02ec-40c1-a581-522a132fb3d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:39.978290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8582d6-02ec-40c1-a581-522a132fb3d3 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:40.000180 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 711/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:42.209989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d672af-dc8d-424a-8929-548bfae7f3f9 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:42.210578 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d672af-dc8d-424a-8929-548bfae7f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:42.210578 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d672af-dc8d-424a-8929-548bfae7f3f9 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:42.211875 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 696/1407] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:49:42.217543 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708567a-8cb7-49cc-8406-a0c278f0c590 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:42.217988 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708567a-8cb7-49cc-8406-a0c278f0c590 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:42.218155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708567a-8cb7-49cc-8406-a0c278f0c590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:42.290510 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-b708567a-8cb7-49cc-8406-a0c278f0c590 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:42.295497 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-b708567a-8cb7-49cc-8406-a0c278f0c590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:42.404735 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 712/1408] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:42.719978 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d672af-dc8d-424a-8929-548bfae7f3f9 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:42.722849 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f3d672af-dc8d-424a-8929-548bfae7f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:42.897691 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d672af-dc8d-424a-8929-548bfae7f3f9 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:42.938321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:43.024062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaed40a-f21c-417a-91e3-326c55591214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:43.024755 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed40a-f21c-417a-91e3-326c55591214 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:43.025073 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed40a-f21c-417a-91e3-326c55591214 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:43.025367 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed40a-f21c-417a-91e3-326c55591214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:43.027014 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-feaed40a-f21c-417a-91e3-326c55591214 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:43.131744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaed40a-f21c-417a-91e3-326c55591214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:43.133825 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaed40a-f21c-417a-91e3-326c55591214 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:43.154321 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 697/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:52.403721 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=76 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:53.151902 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=83 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:02.175583 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33b83a-e6f4-413a-aaad-4965f0b40061 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:02.176206 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33b83a-e6f4-413a-aaad-4965f0b40061 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:02.176206 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33b83a-e6f4-413a-aaad-4965f0b40061 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:02.177472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 713/1410] 10.222.0.43 () {54 vars in 918 bytes} [Sun Oct 9 00:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:02.182965 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f630ca-52b1-44a6-b318-bce8997fc46c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:02.183407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f630ca-52b1-44a6-b318-bce8997fc46c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:02.183533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f630ca-52b1-44a6-b318-bce8997fc46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:02.279600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b3f630ca-52b1-44a6-b318-bce8997fc46c None None] MFA Rules not processed for user `536ebcc364834a75beefab0f2b0cc196`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:02.280833 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b3f630ca-52b1-44a6-b318-bce8997fc46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:02.403195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 698/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Sun Oct 9 00:50:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:02.423879 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6baca-d25a-487b-9c1c-8b169718243a None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:02.424301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6baca-d25a-487b-9c1c-8b169718243a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:02.424670 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6baca-d25a-487b-9c1c-8b169718243a None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:02.426213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 714/1412] 10.222.0.43 () {54 vars in 918 bytes} [Sun Oct 9 00:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:02.433919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286371d-7679-428c-b9e6-7c9fb301261f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:02.434290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286371d-7679-428c-b9e6-7c9fb301261f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:02.434630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286371d-7679-428c-b9e6-7c9fb301261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:02.513820 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:02.516675 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9286371d-7679-428c-b9e6-7c9fb301261f None None] MFA Rules not processed for user `f960fdabbffa4813a0ea46bb82218f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:02.518418 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9286371d-7679-428c-b9e6-7c9fb301261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:02.643216 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 699/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Sun Oct 9 00:50:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:05.311268 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a858-fe22-4e1f-8ca7-4b7e8763708f None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:05.312222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a858-fe22-4e1f-8ca7-4b7e8763708f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:05.312222 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a858-fe22-4e1f-8ca7-4b7e8763708f None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:05.314290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:05.319904 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730955-8a94-4170-a7ed-423cfabd72b7 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:05.320409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730955-8a94-4170-a7ed-423cfabd72b7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:05.320516 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730955-8a94-4170-a7ed-423cfabd72b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:05.389518 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-78730955-8a94-4170-a7ed-423cfabd72b7 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:05.390728 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-78730955-8a94-4170-a7ed-423cfabd72b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:05.446802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:05.495345 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:05.787793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a858-fe22-4e1f-8ca7-4b7e8763708f None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:05.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-f306a858-fe22-4e1f-8ca7-4b7e8763708f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:05.943741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a858-fe22-4e1f-8ca7-4b7e8763708f None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:06.027453 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:06.068546 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9b105-feb8-410e-a278-35595e76a6f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:06.069153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9b105-feb8-410e-a278-35595e76a6f8 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:06.069423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9b105-feb8-410e-a278-35595e76a6f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:06.069690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9b105-feb8-410e-a278-35595e76a6f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:06.071289 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-50d9b105-feb8-410e-a278-35595e76a6f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:06.164982 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9b105-feb8-410e-a278-35595e76a6f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:06.166575 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9b105-feb8-410e-a278-35595e76a6f8 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:06.185517 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 716/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:07.333445 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a8cb4-a59b-4bf3-96e5-ecc930c45d43 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:07.334025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a8cb4-a59b-4bf3-96e5-ecc930c45d43 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:07.334025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a8cb4-a59b-4bf3-96e5-ecc930c45d43 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:07.335325 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:07.342611 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0638f-1a24-4d2c-b744-f7eef9196ab1 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:07.343086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0638f-1a24-4d2c-b744-f7eef9196ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:07.343086 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0638f-1a24-4d2c-b744-f7eef9196ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:07.433425 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-7ca0638f-1a24-4d2c-b744-f7eef9196ab1 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:07.435490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-7ca0638f-1a24-4d2c-b744-f7eef9196ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:07.468619 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:07.543180 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:07.697958 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a8cb4-a59b-4bf3-96e5-ecc930c45d43 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:07.699824 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-982a8cb4-a59b-4bf3-96e5-ecc930c45d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:07.858494 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a8cb4-a59b-4bf3-96e5-ecc930c45d43 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:07.900891 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:07.980772 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b879577-e3ed-477d-b5f5-3ab656a5811d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:07.981379 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b879577-e3ed-477d-b5f5-3ab656a5811d service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:07.981666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b879577-e3ed-477d-b5f5-3ab656a5811d service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:07.981951 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b879577-e3ed-477d-b5f5-3ab656a5811d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:07.983523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-4b879577-e3ed-477d-b5f5-3ab656a5811d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:08.078424 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b879577-e3ed-477d-b5f5-3ab656a5811d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:08.080082 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b879577-e3ed-477d-b5f5-3ab656a5811d service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:08.100162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 702/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:09.251442 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686687a-4e97-4151-a8e1-9285463aefdd None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:09.252349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686687a-4e97-4151-a8e1-9285463aefdd None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:09.252349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686687a-4e97-4151-a8e1-9285463aefdd None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:09.254522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:50:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:09.264265 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b5a3-d66f-49d3-acf3-ddcae937d90d None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:09.264737 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b5a3-d66f-49d3-acf3-ddcae937d90d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:09.264848 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b5a3-d66f-49d3-acf3-ddcae937d90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:09.333964 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:09.360866 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5ea1b5a3-d66f-49d3-acf3-ddcae937d90d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:09.362082 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5ea1b5a3-d66f-49d3-acf3-ddcae937d90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:09.460097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:09.615358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686687a-4e97-4151-a8e1-9285463aefdd None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:09.617708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-9686687a-4e97-4151-a8e1-9285463aefdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:09.770094 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686687a-4e97-4151-a8e1-9285463aefdd None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:09.783503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:09.891784 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7f7df-e0d3-410b-a7e0-e8f9958f4fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:09.892386 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7f7df-e0d3-410b-a7e0-e8f9958f4fdb service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:09.892663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7f7df-e0d3-410b-a7e0-e8f9958f4fdb service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:09.892961 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7f7df-e0d3-410b-a7e0-e8f9958f4fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:09.894568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-bae7f7df-e0d3-410b-a7e0-e8f9958f4fdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:10.000424 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7f7df-e0d3-410b-a7e0-e8f9958f4fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:10.002860 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7f7df-e0d3-410b-a7e0-e8f9958f4fdb service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:10.025570 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 719/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:11.159498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4556a8-7735-4e4f-a215-ff832fab9956 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:11.160374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4556a8-7735-4e4f-a215-ff832fab9956 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:11.160374 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4556a8-7735-4e4f-a215-ff832fab9956 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:11.162339 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:50:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:11.172103 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59844d55-c556-46d8-9941-92df04e6ea80 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:11.172584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59844d55-c556-46d8-9941-92df04e6ea80 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:11.172679 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59844d55-c556-46d8-9941-92df04e6ea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:11.194321 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:11.261592 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-59844d55-c556-46d8-9941-92df04e6ea80 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:11.262898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-59844d55-c556-46d8-9941-92df04e6ea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:11.365150 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:11.514199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4556a8-7735-4e4f-a215-ff832fab9956 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:11.515692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2e4556a8-7735-4e4f-a215-ff832fab9956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:11.644876 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:11.689763 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4556a8-7735-4e4f-a215-ff832fab9956 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:11.825313 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b927d6-fb94-4227-8fde-4176f3883914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:11.826203 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b927d6-fb94-4227-8fde-4176f3883914 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:11.826500 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b927d6-fb94-4227-8fde-4176f3883914 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:11.826770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b927d6-fb94-4227-8fde-4176f3883914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:11.828410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-86b927d6-fb94-4227-8fde-4176f3883914 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:12.031444 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:12.046861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b927d6-fb94-4227-8fde-4176f3883914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:12.048452 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b927d6-fb94-4227-8fde-4176f3883914 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:12.067692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 705/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:50:13.172558 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d91b0-9075-4470-97ba-8b492f21e34a None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:13.173192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d91b0-9075-4470-97ba-8b492f21e34a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:13.173192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d91b0-9075-4470-97ba-8b492f21e34a None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:13.174452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:13.180904 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df80d3-e6c9-4a31-9d4b-171f66634ecd None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:13.181375 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df80d3-e6c9-4a31-9d4b-171f66634ecd None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:13.181482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df80d3-e6c9-4a31-9d4b-171f66634ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:13.258445 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-37df80d3-e6c9-4a31-9d4b-171f66634ecd None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:13.259629 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-37df80d3-e6c9-4a31-9d4b-171f66634ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:13.357656 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:13.508134 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d91b0-9075-4470-97ba-8b492f21e34a None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:13.509650 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-c26d91b0-9075-4470-97ba-8b492f21e34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:13.600465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:13.674301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d91b0-9075-4470-97ba-8b492f21e34a None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:13.807325 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de824c61-8190-457f-b697-514cf698916a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:13.807937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824c61-8190-457f-b697-514cf698916a service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:13.808247 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824c61-8190-457f-b697-514cf698916a service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:13.808519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824c61-8190-457f-b697-514cf698916a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:13.810152 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-de824c61-8190-457f-b697-514cf698916a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:13.862201 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:13.906108 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de824c61-8190-457f-b697-514cf698916a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:13.908627 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de824c61-8190-457f-b697-514cf698916a service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:13.936408 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 722/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:50:15.007487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe54b7f-d14f-4263-a236-21d3ffdc7a25 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:15.008475 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe54b7f-d14f-4263-a236-21d3ffdc7a25 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:15.008475 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe54b7f-d14f-4263-a236-21d3ffdc7a25 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:15.010697 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:50:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:15.018317 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d8c5f-5964-4c2e-af8f-2dc910460b9a None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:15.019099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d8c5f-5964-4c2e-af8f-2dc910460b9a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:15.019274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d8c5f-5964-4c2e-af8f-2dc910460b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:15.105030 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-be9d8c5f-5964-4c2e-af8f-2dc910460b9a None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:15.106133 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-be9d8c5f-5964-4c2e-af8f-2dc910460b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:15.209190 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:15.360497 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe54b7f-d14f-4263-a236-21d3ffdc7a25 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:15.361940 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-abe54b7f-d14f-4263-a236-21d3ffdc7a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:15.414200 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:15.532483 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe54b7f-d14f-4263-a236-21d3ffdc7a25 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:15.660458 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc8b52-b34f-4fb3-9ed6-ad4fd6efab50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:15.660965 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc8b52-b34f-4fb3-9ed6-ad4fd6efab50 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:15.661487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc8b52-b34f-4fb3-9ed6-ad4fd6efab50 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:15.661863 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc8b52-b34f-4fb3-9ed6-ad4fd6efab50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:15.663683 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-90cc8b52-b34f-4fb3-9ed6-ad4fd6efab50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:15.671372 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:15.758106 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc8b52-b34f-4fb3-9ed6-ad4fd6efab50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:15.759680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc8b52-b34f-4fb3-9ed6-ad4fd6efab50 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:15.777868 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 708/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:16.809640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d78361-3f7f-412b-936e-23623c271107 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:16.810285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d78361-3f7f-412b-936e-23623c271107 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:16.810285 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d78361-3f7f-412b-936e-23623c271107 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:16.811498 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:16.817985 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea7f7-f341-42f1-9b84-c23995943ae4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:16.818471 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea7f7-f341-42f1-9b84-c23995943ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:16.818577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea7f7-f341-42f1-9b84-c23995943ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:16.902480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1a5ea7f7-f341-42f1-9b84-c23995943ae4 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:16.903900 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1a5ea7f7-f341-42f1-9b84-c23995943ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:16.992492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:17.026069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:17.177656 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d78361-3f7f-412b-936e-23623c271107 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:17.179892 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-88d78361-3f7f-412b-936e-23623c271107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:17.199973 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:17.342540 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d78361-3f7f-412b-936e-23623c271107 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:17.444386 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:17.471687 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8a7e6-46a9-418d-9af9-67c85377d269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:17.472384 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8a7e6-46a9-418d-9af9-67c85377d269 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:17.472663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8a7e6-46a9-418d-9af9-67c85377d269 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:17.473157 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8a7e6-46a9-418d-9af9-67c85377d269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:17.475000 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-96e8a7e6-46a9-418d-9af9-67c85377d269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:17.577258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8a7e6-46a9-418d-9af9-67c85377d269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:17.578874 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8a7e6-46a9-418d-9af9-67c85377d269 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:17.599876 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 725/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:18.685297 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822c03d-88b6-4aaf-a77c-d437ee57a194 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:18.686230 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822c03d-88b6-4aaf-a77c-d437ee57a194 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:18.686230 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822c03d-88b6-4aaf-a77c-d437ee57a194 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:18.688295 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:50:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:18.698667 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b609b-7009-477d-957c-995e45d67d7d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:18.699159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b609b-7009-477d-957c-995e45d67d7d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:18.699265 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b609b-7009-477d-957c-995e45d67d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:18.789402 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-c98b609b-7009-477d-957c-995e45d67d7d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:18.790944 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-c98b609b-7009-477d-957c-995e45d67d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:18.834800 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:18.893231 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:19.055858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822c03d-88b6-4aaf-a77c-d437ee57a194 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:19.058492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-a822c03d-88b6-4aaf-a77c-d437ee57a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:19.217524 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822c03d-88b6-4aaf-a77c-d437ee57a194 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:19.281442 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:19.347013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d1bfc-fb27-4412-9550-901c79ec1ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:19.347531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d1bfc-fb27-4412-9550-901c79ec1ef6 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:19.347804 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d1bfc-fb27-4412-9550-901c79ec1ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:19.348092 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d1bfc-fb27-4412-9550-901c79ec1ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:19.349689 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e52d1bfc-fb27-4412-9550-901c79ec1ef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:19.443489 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d1bfc-fb27-4412-9550-901c79ec1ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:19.445109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d1bfc-fb27-4412-9550-901c79ec1ef6 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:19.464790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 711/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:20.542519 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1ed06-ebf3-4d1f-b502-d27605c308b0 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:20.543492 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1ed06-ebf3-4d1f-b502-d27605c308b0 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:20.543492 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1ed06-ebf3-4d1f-b502-d27605c308b0 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:20.545262 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:50:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:20.556313 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70d25c-bbd2-45e3-9b1e-8618c8da519e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:20.556878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70d25c-bbd2-45e3-9b1e-8618c8da519e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:20.556878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70d25c-bbd2-45e3-9b1e-8618c8da519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:20.640588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0f70d25c-bbd2-45e3-9b1e-8618c8da519e None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:20.641809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0f70d25c-bbd2-45e3-9b1e-8618c8da519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:20.643821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:20.744019 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:20.900497 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1ed06-ebf3-4d1f-b502-d27605c308b0 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:20.902950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-66e1ed06-ebf3-4d1f-b502-d27605c308b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:21.056568 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1ed06-ebf3-4d1f-b502-d27605c308b0 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:21.084064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:21.182373 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94402b-4cf1-48de-99e2-b0f34b5a5aa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:21.183247 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94402b-4cf1-48de-99e2-b0f34b5a5aa7 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:21.183593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94402b-4cf1-48de-99e2-b0f34b5a5aa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:21.183963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94402b-4cf1-48de-99e2-b0f34b5a5aa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:21.186684 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-ba94402b-4cf1-48de-99e2-b0f34b5a5aa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:21.288527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94402b-4cf1-48de-99e2-b0f34b5a5aa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:21.290120 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94402b-4cf1-48de-99e2-b0f34b5a5aa7 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:21.308710 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 728/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:23.350361 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b03f8-c1fe-4139-a015-258604723fed None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:23.351036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b03f8-c1fe-4139-a015-258604723fed None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:23.351036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b03f8-c1fe-4139-a015-258604723fed None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:23.352895 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:23.358525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2419b-1fc6-4084-9717-298b4ecb88a1 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:23.358992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2419b-1fc6-4084-9717-298b4ecb88a1 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:23.359104 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2419b-1fc6-4084-9717-298b4ecb88a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:23.401099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:23.428272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-6af2419b-1fc6-4084-9717-298b4ecb88a1 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:23.429486 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-6af2419b-1fc6-4084-9717-298b4ecb88a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:23.527931 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:23.818875 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b03f8-c1fe-4139-a015-258604723fed None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:23.821485 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f77b03f8-c1fe-4139-a015-258604723fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:23.944067 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b03f8-c1fe-4139-a015-258604723fed None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:23.982126 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:24.029848 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d5fb5-2e00-4203-a9cd-820ece70d43c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:24.030453 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5fb5-2e00-4203-a9cd-820ece70d43c service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:24.030723 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5fb5-2e00-4203-a9cd-820ece70d43c service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:24.030987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5fb5-2e00-4203-a9cd-820ece70d43c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:24.032602 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0d1d5fb5-2e00-4203-a9cd-820ece70d43c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:24.159883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d5fb5-2e00-4203-a9cd-820ece70d43c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:24.162055 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d5fb5-2e00-4203-a9cd-820ece70d43c service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:24.184936 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 714/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:26.496652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442947c9-9d4b-486a-9756-2d98a6ece876 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:26.497246 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442947c9-9d4b-486a-9756-2d98a6ece876 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:26.497246 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442947c9-9d4b-486a-9756-2d98a6ece876 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:26.499710 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:26.508324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930076c5-b606-4851-ac22-b7e92a5e4c7c None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:26.508758 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930076c5-b606-4851-ac22-b7e92a5e4c7c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:26.508861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930076c5-b606-4851-ac22-b7e92a5e4c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:26.578688 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-930076c5-b606-4851-ac22-b7e92a5e4c7c None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:26.579894 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-930076c5-b606-4851-ac22-b7e92a5e4c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:26.594289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:26.689525 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:26.977494 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442947c9-9d4b-486a-9756-2d98a6ece876 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:26.979109 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-442947c9-9d4b-486a-9756-2d98a6ece876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:27.095524 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442947c9-9d4b-486a-9756-2d98a6ece876 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:27.108835 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:27.176448 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b774b-200a-4015-b390-89ee07a9bc3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:27.177019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b774b-200a-4015-b390-89ee07a9bc3b service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:27.177292 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b774b-200a-4015-b390-89ee07a9bc3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:27.177560 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b774b-200a-4015-b390-89ee07a9bc3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:27.179150 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-019b774b-200a-4015-b390-89ee07a9bc3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:27.296996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b774b-200a-4015-b390-89ee07a9bc3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:27.298429 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b774b-200a-4015-b390-89ee07a9bc3b service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:27.317274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 731/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:29.758486 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45ae3-3394-4065-a4d9-edf54a5c0bf8 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:29.759331 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45ae3-3394-4065-a4d9-edf54a5c0bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:29.759331 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45ae3-3394-4065-a4d9-edf54a5c0bf8 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:29.761587 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:29.771041 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466712e-a6b0-4f16-9c5c-21aff80f466d None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:29.771524 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466712e-a6b0-4f16-9c5c-21aff80f466d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:29.771628 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466712e-a6b0-4f16-9c5c-21aff80f466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:29.824241 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:29.843030 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-9466712e-a6b0-4f16-9c5c-21aff80f466d None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:29.844250 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-9466712e-a6b0-4f16-9c5c-21aff80f466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:29.944483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:30.232025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced45ae3-3394-4065-a4d9-edf54a5c0bf8 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:30.233628 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ced45ae3-3394-4065-a4d9-edf54a5c0bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:30.355632 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced45ae3-3394-4065-a4d9-edf54a5c0bf8 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:30.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:30.435476 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bb085-89f2-423f-bed6-975060f15185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:30.436085 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bb085-89f2-423f-bed6-975060f15185 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:30.436410 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bb085-89f2-423f-bed6-975060f15185 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:30.436678 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bb085-89f2-423f-bed6-975060f15185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:30.438313 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b56bb085-89f2-423f-bed6-975060f15185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:30.562548 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bb085-89f2-423f-bed6-975060f15185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:30.563917 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bb085-89f2-423f-bed6-975060f15185 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:30.584165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 717/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:32.923501 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43fa01-690f-4623-a60c-9239b84a8cd6 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:32.924161 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43fa01-690f-4623-a60c-9239b84a8cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:32.924161 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43fa01-690f-4623-a60c-9239b84a8cd6 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:32.925477 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:32.934352 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacbd5e-93f7-4948-8be1-1679ca171b51 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:32.934858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacbd5e-93f7-4948-8be1-1679ca171b51 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:32.935228 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacbd5e-93f7-4948-8be1-1679ca171b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:33.014024 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-abacbd5e-93f7-4948-8be1-1679ca171b51 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:33.015244 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-abacbd5e-93f7-4948-8be1-1679ca171b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:33.038380 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:33.132642 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:33.441695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43fa01-690f-4623-a60c-9239b84a8cd6 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:33.444233 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-6c43fa01-690f-4623-a60c-9239b84a8cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:33.578606 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43fa01-690f-4623-a60c-9239b84a8cd6 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:33.602704 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:33.795775 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ae90f-64d7-4269-9ddc-fc81e10c3d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:33.796423 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae90f-64d7-4269-9ddc-fc81e10c3d78 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:33.796695 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae90f-64d7-4269-9ddc-fc81e10c3d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:33.796958 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae90f-64d7-4269-9ddc-fc81e10c3d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:33.798526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-d91ae90f-64d7-4269-9ddc-fc81e10c3d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:33.913998 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ae90f-64d7-4269-9ddc-fc81e10c3d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:33.915442 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ae90f-64d7-4269-9ddc-fc81e10c3d78 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:33.933869 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 734/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:36.419959 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b604-50c4-4abd-89c0-f1e9a4e52296 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:36.420639 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b604-50c4-4abd-89c0-f1e9a4e52296 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:36.420639 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b604-50c4-4abd-89c0-f1e9a4e52296 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:36.421995 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:36.427837 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a73b-e7a2-494a-8443-c38b474fa535 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:36.428279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a73b-e7a2-494a-8443-c38b474fa535 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:36.428456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a73b-e7a2-494a-8443-c38b474fa535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:36.497540 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:36.501563 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-45d7a73b-e7a2-494a-8443-c38b474fa535 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:36.503518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-45d7a73b-e7a2-494a-8443-c38b474fa535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:36.604239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:36.902600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046b604-50c4-4abd-89c0-f1e9a4e52296 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:36.904556 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9046b604-50c4-4abd-89c0-f1e9a4e52296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:37.022407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046b604-50c4-4abd-89c0-f1e9a4e52296 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:37.085731 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:37.115634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cfbef-aa50-4f5c-b923-28cfdc6ad08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:37.116543 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cfbef-aa50-4f5c-b923-28cfdc6ad08d service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:37.116922 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cfbef-aa50-4f5c-b923-28cfdc6ad08d service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:37.117308 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cfbef-aa50-4f5c-b923-28cfdc6ad08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:37.119712 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3c0cfbef-aa50-4f5c-b923-28cfdc6ad08d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:37.245106 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cfbef-aa50-4f5c-b923-28cfdc6ad08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:37.247143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cfbef-aa50-4f5c-b923-28cfdc6ad08d service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:37.266106 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 720/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:50:39.513098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca1ad-1a7b-4675-a86d-6304e2176bde None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:39.513600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca1ad-1a7b-4675-a86d-6304e2176bde None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:39.513600 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca1ad-1a7b-4675-a86d-6304e2176bde None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:39.514957 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:39.520878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994c889-e209-4a7e-a1b0-60ff9d629144 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:39.521382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994c889-e209-4a7e-a1b0-60ff9d629144 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:39.521506 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994c889-e209-4a7e-a1b0-60ff9d629144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:39.591977 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-3994c889-e209-4a7e-a1b0-60ff9d629144 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:39.593203 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-3994c889-e209-4a7e-a1b0-60ff9d629144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:39.624007 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:39.695492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:39.984729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfca1ad-1a7b-4675-a86d-6304e2176bde None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:39.987100 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-7bfca1ad-1a7b-4675-a86d-6304e2176bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:40.108036 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfca1ad-1a7b-4675-a86d-6304e2176bde None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:40.139550 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:40.189387 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814e9b6-7ab1-4fb3-a76a-c2aeaed5934a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:40.189993 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e9b6-7ab1-4fb3-a76a-c2aeaed5934a service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:40.190252 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e9b6-7ab1-4fb3-a76a-c2aeaed5934a service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:40.190522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e9b6-7ab1-4fb3-a76a-c2aeaed5934a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:40.192137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-2814e9b6-7ab1-4fb3-a76a-c2aeaed5934a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:40.306995 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814e9b6-7ab1-4fb3-a76a-c2aeaed5934a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:40.308384 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814e9b6-7ab1-4fb3-a76a-c2aeaed5934a service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:40.328351 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 737/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:42.645350 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8e39-34f9-4725-b024-16d507f44b1e None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:42.645927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8e39-34f9-4725-b024-16d507f44b1e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:42.645927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8e39-34f9-4725-b024-16d507f44b1e None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:42.647219 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:42.652870 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c23019-0d96-4e6b-9dc8-b2cf4fcbff11 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:42.653324 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c23019-0d96-4e6b-9dc8-b2cf4fcbff11 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:42.653419 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c23019-0d96-4e6b-9dc8-b2cf4fcbff11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:42.722554 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-c9c23019-0d96-4e6b-9dc8-b2cf4fcbff11 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:42.723732 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-c9c23019-0d96-4e6b-9dc8-b2cf4fcbff11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:42.732490 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:42.822813 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:43.110135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a8e39-34f9-4725-b024-16d507f44b1e None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:43.111672 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-475a8e39-34f9-4725-b024-16d507f44b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:43.221713 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a8e39-34f9-4725-b024-16d507f44b1e None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:43.283671 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:43.302960 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8d4ba-5fb5-4e1e-a093-f377a6646cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:43.303563 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d4ba-5fb5-4e1e-a093-f377a6646cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:43.303831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d4ba-5fb5-4e1e-a093-f377a6646cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:43.304126 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d4ba-5fb5-4e1e-a093-f377a6646cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:43.305692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-33d8d4ba-5fb5-4e1e-a093-f377a6646cf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:43.418973 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8d4ba-5fb5-4e1e-a093-f377a6646cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:43.420342 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8d4ba-5fb5-4e1e-a093-f377a6646cf0 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:43.438904 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 723/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:45.661261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294ff3e-c9ed-49bd-8327-b8f22b3bf4b9 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:45.662191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294ff3e-c9ed-49bd-8327-b8f22b3bf4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:45.662191 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294ff3e-c9ed-49bd-8327-b8f22b3bf4b9 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:45.664335 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:45.671298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458f9f-09c6-43f9-957e-646d8dec407e None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:45.672097 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458f9f-09c6-43f9-957e-646d8dec407e None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:45.672290 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458f9f-09c6-43f9-957e-646d8dec407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:45.760867 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-31458f9f-09c6-43f9-957e-646d8dec407e None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:45.761987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-31458f9f-09c6-43f9-957e-646d8dec407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:45.803500 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:45.864480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:46.148981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294ff3e-c9ed-49bd-8327-b8f22b3bf4b9 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:46.151473 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e294ff3e-c9ed-49bd-8327-b8f22b3bf4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:46.263345 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294ff3e-c9ed-49bd-8327-b8f22b3bf4b9 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:46.306436 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:46.350530 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c6700-1eca-400b-84c8-a6850d2c6fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:46.351176 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c6700-1eca-400b-84c8-a6850d2c6fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:46.351454 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c6700-1eca-400b-84c8-a6850d2c6fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:46.351717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c6700-1eca-400b-84c8-a6850d2c6fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:46.353365 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-5d2c6700-1eca-400b-84c8-a6850d2c6fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:46.477947 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c6700-1eca-400b-84c8-a6850d2c6fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:46.479672 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c6700-1eca-400b-84c8-a6850d2c6fb2 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:46.499606 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 740/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:48.620808 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edef66-8607-47df-9ca0-de8d2bb6ae56 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:48.621417 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edef66-8607-47df-9ca0-de8d2bb6ae56 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:48.621417 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edef66-8607-47df-9ca0-de8d2bb6ae56 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:48.622894 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:48.629649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55160-db85-4d2a-ac21-daa41321d086 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:48.630378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55160-db85-4d2a-ac21-daa41321d086 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:48.630715 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55160-db85-4d2a-ac21-daa41321d086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:48.709080 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-25d55160-db85-4d2a-ac21-daa41321d086 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:48.710299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-25d55160-db85-4d2a-ac21-daa41321d086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:48.729804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:48.815126 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:49.099638 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edef66-8607-47df-9ca0-de8d2bb6ae56 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:49.102052 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-88edef66-8607-47df-9ca0-de8d2bb6ae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:49.221580 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edef66-8607-47df-9ca0-de8d2bb6ae56 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:49.294175 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:49.301432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380fd6d-1178-4ea2-b541-e9572250ce84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:49.302032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380fd6d-1178-4ea2-b541-e9572250ce84 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:49.302302 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380fd6d-1178-4ea2-b541-e9572250ce84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:49.302570 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380fd6d-1178-4ea2-b541-e9572250ce84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:49.304153 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b380fd6d-1178-4ea2-b541-e9572250ce84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:49.428106 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380fd6d-1178-4ea2-b541-e9572250ce84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:49.429499 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380fd6d-1178-4ea2-b541-e9572250ce84 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:49.450398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 726/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:51.602101 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b4ba-8db6-4e25-b6a1-e320d607b4b7 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:51.603031 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b4ba-8db6-4e25-b6a1-e320d607b4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:51.603031 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b4ba-8db6-4e25-b6a1-e320d607b4b7 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:51.605151 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:51.614139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705605ac-3311-4271-81e9-b840ad76df1a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:51.614593 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705605ac-3311-4271-81e9-b840ad76df1a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:51.614699 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705605ac-3311-4271-81e9-b840ad76df1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:51.697834 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-705605ac-3311-4271-81e9-b840ad76df1a None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:51.699052 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-705605ac-3311-4271-81e9-b840ad76df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:51.766289 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:51.822975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:52.099646 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10b4ba-8db6-4e25-b6a1-e320d607b4b7 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:52.101230 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-af10b4ba-8db6-4e25-b6a1-e320d607b4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:52.218512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10b4ba-8db6-4e25-b6a1-e320d607b4b7 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:52.282099 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:52.309751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31437a-38d9-4289-929a-715799ca3058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:52.310347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31437a-38d9-4289-929a-715799ca3058 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:52.310612 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31437a-38d9-4289-929a-715799ca3058 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:52.310875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31437a-38d9-4289-929a-715799ca3058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:52.312478 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-4f31437a-38d9-4289-929a-715799ca3058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:52.420855 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31437a-38d9-4289-929a-715799ca3058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:52.422177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31437a-38d9-4289-929a-715799ca3058 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:52.440507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 743/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:51:01.821366 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=22 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:02.438031 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=66 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:12.510151 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba78d-e334-4f6f-80b9-111e4f546bf4 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:12.510753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba78d-e334-4f6f-80b9-111e4f546bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:12.510753 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba78d-e334-4f6f-80b9-111e4f546bf4 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:12.512923 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 728/1471] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:51:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:51:12.518555 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038da2e-7b1b-4023-85e2-10902ab65e04 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:12.519019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038da2e-7b1b-4023-85e2-10902ab65e04 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:12.519134 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038da2e-7b1b-4023-85e2-10902ab65e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:12.586813 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-6038da2e-7b1b-4023-85e2-10902ab65e04 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:51:12.587994 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-6038da2e-7b1b-4023-85e2-10902ab65e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:12.687451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 744/1472] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:51:12.985548 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebea37-6680-43cd-949a-6470ce83e443 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:12.985827 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebea37-6680-43cd-949a-6470ce83e443 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:12.986125 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebea37-6680-43cd-949a-6470ce83e443 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:12.987479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 729/1473] 10.222.0.43 () {54 vars in 962 bytes} [Sun Oct 9 00:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:51:12.992697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360cc01-cf54-4995-90be-0a9f67fbb0bb None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:12.992972 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360cc01-cf54-4995-90be-0a9f67fbb0bb None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:12.993234 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360cc01-cf54-4995-90be-0a9f67fbb0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:13.071270 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-0360cc01-cf54-4995-90be-0a9f67fbb0bb None None] MFA Rules not processed for user `dbbd529122d64e46a70f62e351b27fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:51:13.072426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-0360cc01-cf54-4995-90be-0a9f67fbb0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:13.093321 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:13.153064 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 745/1474] 10.222.0.43 () {58 vars in 1059 bytes} [Sun Oct 9 00:51:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:51:13.160981 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebea37-6680-43cd-949a-6470ce83e443 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:51:13.162493 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ceebea37-6680-43cd-949a-6470ce83e443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:13.281537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebea37-6680-43cd-949a-6470ce83e443 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:51:13.358340 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfce41-7dbc-44af-b1a9-2202bcddb4dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbd529122d64e46a70f62e351b27fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:51:13.358858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfce41-7dbc-44af-b1a9-2202bcddb4dc service glance] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:13.359126 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfce41-7dbc-44af-b1a9-2202bcddb4dc service glance] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:13.359391 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfce41-7dbc-44af-b1a9-2202bcddb4dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:13.360991 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2fbfce41-7dbc-44af-b1a9-2202bcddb4dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:13.419697 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:13.484861 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfce41-7dbc-44af-b1a9-2202bcddb4dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:51:13.486315 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfce41-7dbc-44af-b1a9-2202bcddb4dc service glance] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:51:13.507663 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 730/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:51:15.763286 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bfca0-4af4-4c9f-b784-7fad13cd46d7 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:15.763908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bfca0-4af4-4c9f-b784-7fad13cd46d7 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:15.763908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bfca0-4af4-4c9f-b784-7fad13cd46d7 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:15.765848 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 746/1476] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:51:15.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e52fd1-8a1b-4a47-b6c5-8b94891b0fb6 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:15.772143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e52fd1-8a1b-4a47-b6c5-8b94891b0fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:15.772143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e52fd1-8a1b-4a47-b6c5-8b94891b0fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:15.841276 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-69e52fd1-8a1b-4a47-b6c5-8b94891b0fb6 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:51:15.842497 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-69e52fd1-8a1b-4a47-b6c5-8b94891b0fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:15.942710 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 731/1477] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:51:16.217002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bfca0-4af4-4c9f-b784-7fad13cd46d7 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:51:16.219345 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3d5bfca0-4af4-4c9f-b784-7fad13cd46d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:16.369347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bfca0-4af4-4c9f-b784-7fad13cd46d7 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:51:16.429734 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:16.478102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a91b6-0a2c-4096-bad5-d82e39a51b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:51:16.478680 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a91b6-0a2c-4096-bad5-d82e39a51b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:16.478948 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a91b6-0a2c-4096-bad5-d82e39a51b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:16.479208 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a91b6-0a2c-4096-bad5-d82e39a51b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:16.479838 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a91b6-0a2c-4096-bad5-d82e39a51b6c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:51:16.481833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: WARNING py.warnings [None req-7c7a91b6-0a2c-4096-bad5-d82e39a51b6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:51:16.481833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: warnings.warn(msg) Oct 09 00:51:16.481833 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: Oct 09 00:51:16.483015 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a91b6-0a2c-4096-bad5-d82e39a51b6c admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:51:16.507965 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 747/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Sun Oct 9 00:51:16 2022] GET /identity/v3/projects => generated 2553 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:51:18.654201 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff94038-68c2-4eb5-a5ad-f30fb9b554ab None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:18.654827 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff94038-68c2-4eb5-a5ad-f30fb9b554ab None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:18.654827 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff94038-68c2-4eb5-a5ad-f30fb9b554ab None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:18.656085 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 732/1479] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:51:18.665128 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da56f9-f655-472a-b0bf-515a8c303efa None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:18.665873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da56f9-f655-472a-b0bf-515a8c303efa None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:18.666073 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da56f9-f655-472a-b0bf-515a8c303efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:18.749475 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-91da56f9-f655-472a-b0bf-515a8c303efa None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:51:18.750690 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-91da56f9-f655-472a-b0bf-515a8c303efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:18.869010 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 748/1480] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:51:19.166683 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff94038-68c2-4eb5-a5ad-f30fb9b554ab None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:51:19.168475 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1ff94038-68c2-4eb5-a5ad-f30fb9b554ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:19.179008 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:19.330527 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff94038-68c2-4eb5-a5ad-f30fb9b554ab None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:51:19.431125 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:19.466981 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840aa16b-2f5d-403b-b7c4-6d872fbfb350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:51:19.467590 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aa16b-2f5d-403b-b7c4-6d872fbfb350 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:19.467866 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aa16b-2f5d-403b-b7c4-6d872fbfb350 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:19.468190 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aa16b-2f5d-403b-b7c4-6d872fbfb350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:19.469762 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-840aa16b-2f5d-403b-b7c4-6d872fbfb350 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:19.565246 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840aa16b-2f5d-403b-b7c4-6d872fbfb350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:51:19.566864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840aa16b-2f5d-403b-b7c4-6d872fbfb350 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:51:19.585657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 733/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:51:21.888947 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18058b0-845c-4691-b665-b82429931688 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:21.889574 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18058b0-845c-4691-b665-b82429931688 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:21.889574 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18058b0-845c-4691-b665-b82429931688 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:21.890819 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 749/1482] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:51:21.897614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172241e-70c0-49a5-a1b9-ce7ab9f8b50f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:21.898430 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172241e-70c0-49a5-a1b9-ce7ab9f8b50f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:21.898712 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172241e-70c0-49a5-a1b9-ce7ab9f8b50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:21.976185 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1172241e-70c0-49a5-a1b9-ce7ab9f8b50f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:51:21.977402 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1172241e-70c0-49a5-a1b9-ce7ab9f8b50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:22.025334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:22.077730 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 734/1483] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:51:22.373885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18058b0-845c-4691-b665-b82429931688 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:51:22.376371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-a18058b0-845c-4691-b665-b82429931688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:22.411180 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:22.506022 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18058b0-845c-4691-b665-b82429931688 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:51:22.587177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4e7c1-d5d4-4bbb-908b-2276475b4201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:51:22.587786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e7c1-d5d4-4bbb-908b-2276475b4201 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:22.588093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e7c1-d5d4-4bbb-908b-2276475b4201 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:22.588343 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e7c1-d5d4-4bbb-908b-2276475b4201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:22.590131 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-8be4e7c1-d5d4-4bbb-908b-2276475b4201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:22.668371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:22.703661 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4e7c1-d5d4-4bbb-908b-2276475b4201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:51:22.705125 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4e7c1-d5d4-4bbb-908b-2276475b4201 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:51:22.723538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 750/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:51:24.903025 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0354d-ca7f-4ce0-8887-c72865405eba None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:24.903618 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0354d-ca7f-4ce0-8887-c72865405eba None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:24.903618 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0354d-ca7f-4ce0-8887-c72865405eba None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:24.904932 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 735/1485] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:51:24.910413 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46552f30-57d9-4fec-946e-49bb90fdfec8 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:24.910862 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46552f30-57d9-4fec-946e-49bb90fdfec8 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:24.910968 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46552f30-57d9-4fec-946e-49bb90fdfec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:24.979613 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-46552f30-57d9-4fec-946e-49bb90fdfec8 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:51:24.980886 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-46552f30-57d9-4fec-946e-49bb90fdfec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:25.083448 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 751/1486] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:51:25.381516 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0354d-ca7f-4ce0-8887-c72865405eba None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:51:25.383062 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b6c0354d-ca7f-4ce0-8887-c72865405eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:25.501482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0354d-ca7f-4ce0-8887-c72865405eba None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:51:25.581363 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:25.582868 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96391d5-6c48-4476-a721-5994405c15f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:51:25.583473 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96391d5-6c48-4476-a721-5994405c15f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:25.583752 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96391d5-6c48-4476-a721-5994405c15f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:25.584026 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96391d5-6c48-4476-a721-5994405c15f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:25.586461 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f96391d5-6c48-4476-a721-5994405c15f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:25.704411 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96391d5-6c48-4476-a721-5994405c15f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:51:25.705812 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96391d5-6c48-4476-a721-5994405c15f0 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:51:25.725262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 736/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:51:27.986882 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376b5e-5fa5-40d1-8fd7-edf5a02dd05d None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:27.987487 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376b5e-5fa5-40d1-8fd7-edf5a02dd05d None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:27.987487 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376b5e-5fa5-40d1-8fd7-edf5a02dd05d None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:27.988824 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 752/1488] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:51:27.995220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d131f9-a096-48f3-b197-0a2281c10b5f None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:27.995921 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d131f9-a096-48f3-b197-0a2281c10b5f None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:27.996694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d131f9-a096-48f3-b197-0a2281c10b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:28.075515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d3d131f9-a096-48f3-b197-0a2281c10b5f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:51:28.076674 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d3d131f9-a096-48f3-b197-0a2281c10b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:28.139565 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:28.195849 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 737/1489] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:51:28.485635 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81376b5e-5fa5-40d1-8fd7-edf5a02dd05d None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:51:28.488081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-81376b5e-5fa5-40d1-8fd7-edf5a02dd05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:28.529472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:28.607523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81376b5e-5fa5-40d1-8fd7-edf5a02dd05d None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:51:28.694107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a390f9-a595-4b36-b8eb-3290c9b0fec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:51:28.694714 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a390f9-a595-4b36-b8eb-3290c9b0fec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:28.694986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a390f9-a595-4b36-b8eb-3290c9b0fec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:28.695287 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a390f9-a595-4b36-b8eb-3290c9b0fec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:28.696905 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-07a390f9-a595-4b36-b8eb-3290c9b0fec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:28.781806 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:28.813253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a390f9-a595-4b36-b8eb-3290c9b0fec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:51:28.814721 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a390f9-a595-4b36-b8eb-3290c9b0fec7 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:51:28.835723 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 753/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:51:31.269163 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41365fb0-a8d7-4068-81d7-b4b08c212466 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:31.269792 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41365fb0-a8d7-4068-81d7-b4b08c212466 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:31.270117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41365fb0-a8d7-4068-81d7-b4b08c212466 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:31.271610 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 738/1491] 10.222.0.43 () {54 vars in 927 bytes} [Sun Oct 9 00:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:51:31.277193 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975febd-dc2e-4c0d-904c-4e516eb378a1 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:31.277629 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975febd-dc2e-4c0d-904c-4e516eb378a1 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:31.277727 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975febd-dc2e-4c0d-904c-4e516eb378a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:31.347226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-7975febd-dc2e-4c0d-904c-4e516eb378a1 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:51:31.348460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-7975febd-dc2e-4c0d-904c-4e516eb378a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:31.448087 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 754/1492] 10.222.0.43 () {58 vars in 1024 bytes} [Sun Oct 9 00:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:51:31.730942 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41365fb0-a8d7-4068-81d7-b4b08c212466 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:51:31.732531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-41365fb0-a8d7-4068-81d7-b4b08c212466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:31.848179 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41365fb0-a8d7-4068-81d7-b4b08c212466 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:51:31.927556 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721b6d2-cbc6-4d84-9830-2d68b6003b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:51:31.928213 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721b6d2-cbc6-4d84-9830-2d68b6003b9e service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:31.928504 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721b6d2-cbc6-4d84-9830-2d68b6003b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:31.928793 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721b6d2-cbc6-4d84-9830-2d68b6003b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:31.930419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e721b6d2-cbc6-4d84-9830-2d68b6003b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:31.939357 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:32.057032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721b6d2-cbc6-4d84-9830-2d68b6003b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:51:32.058493 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721b6d2-cbc6-4d84-9830-2d68b6003b9e service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:51:32.076878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 739/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:51:41.443107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=82 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:42.074480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=50 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:45.584299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44a85d-57ee-4aab-8d8e-016fca8932e5 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:45.584837 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44a85d-57ee-4aab-8d8e-016fca8932e5 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:45.584837 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44a85d-57ee-4aab-8d8e-016fca8932e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:45.681365 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-4b44a85d-57ee-4aab-8d8e-016fca8932e5 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:52:45.682820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-4b44a85d-57ee-4aab-8d8e-016fca8932e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:45.802531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 755/1494] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:52:45.810781 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e60a40-161e-4f13-9468-a670bc30c468 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:45.811283 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e60a40-161e-4f13-9468-a670bc30c468 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:45.811382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e60a40-161e-4f13-9468-a670bc30c468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:45.889548 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-49e60a40-161e-4f13-9468-a670bc30c468 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:52:45.890660 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-49e60a40-161e-4f13-9468-a670bc30c468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:46.007313 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 740/1495] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:52:46.012460 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44a85d-57ee-4aab-8d8e-016fca8932e5 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:46.013668 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-4b44a85d-57ee-4aab-8d8e-016fca8932e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:46.025806 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44a85d-57ee-4aab-8d8e-016fca8932e5 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:46.091604 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:46.126457 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad0200-8319-4e88-a919-cf9647aa8016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:46.127065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad0200-8319-4e88-a919-cf9647aa8016 admin admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:46.127340 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad0200-8319-4e88-a919-cf9647aa8016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:46.127596 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad0200-8319-4e88-a919-cf9647aa8016 admin admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:46.128261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad0200-8319-4e88-a919-cf9647aa8016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:52:46.128561 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad0200-8319-4e88-a919-cf9647aa8016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:46.129571 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: WARNING py.warnings [None req-03ad0200-8319-4e88-a919-cf9647aa8016 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:46.129571 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: warnings.warn(msg) Oct 09 00:52:46.129571 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: Oct 09 00:52:46.130445 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad0200-8319-4e88-a919-cf9647aa8016 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:46.142160 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 756/1496] 10.222.0.43 () {58 vars in 1153 bytes} [Sun Oct 9 00:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:52:46.150996 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e60a40-161e-4f13-9468-a670bc30c468 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:46.161210 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e60a40-161e-4f13-9468-a670bc30c468 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:46.227490 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:46.270400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78766ed6-0096-48fb-bcd8-2a9558444e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:46.271005 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78766ed6-0096-48fb-bcd8-2a9558444e3d admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:46.271277 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78766ed6-0096-48fb-bcd8-2a9558444e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:46.271544 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78766ed6-0096-48fb-bcd8-2a9558444e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:46.272217 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78766ed6-0096-48fb-bcd8-2a9558444e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:46.273967 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: WARNING py.warnings [None req-78766ed6-0096-48fb-bcd8-2a9558444e3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:46.273967 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: warnings.warn(msg) Oct 09 00:52:46.273967 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: Oct 09 00:52:46.275173 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78766ed6-0096-48fb-bcd8-2a9558444e3d admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:46.334680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 741/1497] 10.222.0.43 () {60 vars in 1153 bytes} [Sun Oct 9 00:52:46 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:52:46.339079 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad0200-8319-4e88-a919-cf9647aa8016 admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:46.340645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-03ad0200-8319-4e88-a919-cf9647aa8016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:46.376626 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad0200-8319-4e88-a919-cf9647aa8016 admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:46.474239 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09198998-cd44-497c-91bb-efac63fc163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:46.474865 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09198998-cd44-497c-91bb-efac63fc163a admin admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:46.475138 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09198998-cd44-497c-91bb-efac63fc163a admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:46.475406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09198998-cd44-497c-91bb-efac63fc163a admin admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:46.476024 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09198998-cd44-497c-91bb-efac63fc163a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:46.477065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: WARNING py.warnings [None req-09198998-cd44-497c-91bb-efac63fc163a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:46.477065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: warnings.warn(msg) Oct 09 00:52:46.477065 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: Oct 09 00:52:46.478272 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09198998-cd44-497c-91bb-efac63fc163a admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:46.522343 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 757/1498] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:52:46 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:52:46.527053 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78766ed6-0096-48fb-bcd8-2a9558444e3d admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:46.528562 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-78766ed6-0096-48fb-bcd8-2a9558444e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:46.599781 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78766ed6-0096-48fb-bcd8-2a9558444e3d admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:46.699452 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:46.713560 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d86a4-d9d5-4f7e-a8e7-a811d948fa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:46.714654 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d86a4-d9d5-4f7e-a8e7-a811d948fa1f admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:46.714947 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d86a4-d9d5-4f7e-a8e7-a811d948fa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:46.715255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d86a4-d9d5-4f7e-a8e7-a811d948fa1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:46.716176 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d86a4-d9d5-4f7e-a8e7-a811d948fa1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:46.717743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: WARNING py.warnings [None req-cf2d86a4-d9d5-4f7e-a8e7-a811d948fa1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:46.717743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: warnings.warn(msg) Oct 09 00:52:46.717743 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: Oct 09 00:52:46.719003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d86a4-d9d5-4f7e-a8e7-a811d948fa1f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:46.737334 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 742/1499] 10.222.0.43 () {58 vars in 1122 bytes} [Sun Oct 9 00:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:52:46.741702 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09198998-cd44-497c-91bb-efac63fc163a admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:46.743288 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-09198998-cd44-497c-91bb-efac63fc163a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:46.755182 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09198998-cd44-497c-91bb-efac63fc163a admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:46.781459 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:46.857611 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1d221-8331-42c8-8785-35b69e15b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:46.858220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d221-8331-42c8-8785-35b69e15b697 admin admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:46.858493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d221-8331-42c8-8785-35b69e15b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:46.858751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d221-8331-42c8-8785-35b69e15b697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:46.859389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1d221-8331-42c8-8785-35b69e15b697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:46.860439 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: WARNING py.warnings [None req-7fc1d221-8331-42c8-8785-35b69e15b697 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:46.860439 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: warnings.warn(msg) Oct 09 00:52:46.860439 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: Oct 09 00:52:46.861319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1d221-8331-42c8-8785-35b69e15b697 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:46.874507 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 758/1500] 10.222.0.43 () {58 vars in 1122 bytes} [Sun Oct 9 00:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:52:46.879037 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d86a4-d9d5-4f7e-a8e7-a811d948fa1f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:46.880616 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cf2d86a4-d9d5-4f7e-a8e7-a811d948fa1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:46.915855 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d86a4-d9d5-4f7e-a8e7-a811d948fa1f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:47.024899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ed85e-664c-4803-a42e-42cd596a3883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:47.025538 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ed85e-664c-4803-a42e-42cd596a3883 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:47.025810 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ed85e-664c-4803-a42e-42cd596a3883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:47.026106 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ed85e-664c-4803-a42e-42cd596a3883 admin admin] PATH_INFO: `/v3/projects/f0bdbaf4ebad45be91b1e8de297d6d09/users/60b069762dbc4b34b23609e4391f52b6/roles/fa4a34a109e44660bbce4320a4c9a366` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:47.054507 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ed85e-664c-4803-a42e-42cd596a3883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bdbaf4ebad45be91b1e8de297d6d09, user_id=60b069762dbc4b34b23609e4391f52b6, role_id=fa4a34a109e44660bbce4320a4c9a366)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:47.056102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: WARNING py.warnings [None req-533ed85e-664c-4803-a42e-42cd596a3883 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:47.056102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: warnings.warn(msg) Oct 09 00:52:47.056102 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: Oct 09 00:52:47.058578 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ed85e-664c-4803-a42e-42cd596a3883 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:47.085827 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 743/1501] 10.222.0.43 () {60 vars in 1483 bytes} [Sun Oct 9 00:52:46 2022] PUT /identity/v3/projects/f0bdbaf4ebad45be91b1e8de297d6d09/users/60b069762dbc4b34b23609e4391f52b6/roles/fa4a34a109e44660bbce4320a4c9a366 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:52:47.098976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420f3b-2ccd-4a8a-84d1-19cbba9e0e97 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:47.099251 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420f3b-2ccd-4a8a-84d1-19cbba9e0e97 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:47.099521 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420f3b-2ccd-4a8a-84d1-19cbba9e0e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:47.165891 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-f1420f3b-2ccd-4a8a-84d1-19cbba9e0e97 None None] MFA Rules not processed for user `60b069762dbc4b34b23609e4391f52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:52:47.168205 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-f1420f3b-2ccd-4a8a-84d1-19cbba9e0e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:47.257062 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 759/1502] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:52:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:52:47.272345 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a976-c204-41bf-a375-2ff1ba03ae7d None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:47.272690 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a976-c204-41bf-a375-2ff1ba03ae7d None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:47.273030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a976-c204-41bf-a375-2ff1ba03ae7d None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:47.275164 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 744/1503] 10.222.0.43 () {54 vars in 963 bytes} [Sun Oct 9 00:52:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:52:47.280443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932c53-57f1-4ec6-8b4c-6e125092de94 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:47.280757 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932c53-57f1-4ec6-8b4c-6e125092de94 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:47.281165 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932c53-57f1-4ec6-8b4c-6e125092de94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:47.314686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:47.366199 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-9b932c53-57f1-4ec6-8b4c-6e125092de94 None None] MFA Rules not processed for user `a44cd61c1bfd4ed29e7ede8f8e3a22be`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:52:47.367446 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-9b932c53-57f1-4ec6-8b4c-6e125092de94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:47.449529 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 760/1504] 10.222.0.43 () {58 vars in 1060 bytes} [Sun Oct 9 00:52:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:52:47.459904 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9a976-c204-41bf-a375-2ff1ba03ae7d None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:47.461455 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e9d9a976-c204-41bf-a375-2ff1ba03ae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:47.514542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:47.571445 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9a976-c204-41bf-a375-2ff1ba03ae7d None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:47.652514 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266139ec-51c1-4fe8-9219-bd7da81f6927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44cd61c1bfd4ed29e7ede8f8e3a22be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:47.653121 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266139ec-51c1-4fe8-9219-bd7da81f6927 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:47.653399 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266139ec-51c1-4fe8-9219-bd7da81f6927 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:47.653667 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266139ec-51c1-4fe8-9219-bd7da81f6927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:47.655343 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-266139ec-51c1-4fe8-9219-bd7da81f6927 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:47.763220 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266139ec-51c1-4fe8-9219-bd7da81f6927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:47.764712 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266139ec-51c1-4fe8-9219-bd7da81f6927 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:47.768207 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:47.785016 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 745/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:52:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:52:47.837810 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfe202-6969-4ff2-b3ec-b56196a68f55 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:47.838301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfe202-6969-4ff2-b3ec-b56196a68f55 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:47.838479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfe202-6969-4ff2-b3ec-b56196a68f55 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:47.839754 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 761/1506] 10.222.0.43 () {52 vars in 830 bytes} [Sun Oct 9 00:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:52:47.844442 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266139ec-51c1-4fe8-9219-bd7da81f6927 service cinder] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:47.846312 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-266139ec-51c1-4fe8-9219-bd7da81f6927 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:47.956275 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266139ec-51c1-4fe8-9219-bd7da81f6927 service cinder] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:48.054932 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:48.055555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:48.055822 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:48.056071 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] PATH_INFO: `/v3/users/60b069762dbc4b34b23609e4391f52b6` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:48.070050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b069762dbc4b34b23609e4391f52b6)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:48.071074 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: WARNING py.warnings [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:48.071074 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: warnings.warn(msg) Oct 09 00:52:48.071074 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: Oct 09 00:52:48.072450 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:48.082298 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:48.139577 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b069762dbc4b34b23609e4391f52b6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:48.140009 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b069762dbc4b34b23609e4391f52b6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:48.163722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b069762dbc4b34b23609e4391f52b6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:48.175431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b069762dbc4b34b23609e4391f52b6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:48.175930 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b069762dbc4b34b23609e4391f52b6'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:48.198700 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 746/1507] 10.222.0.43 () {58 vars in 1224 bytes} [Sun Oct 9 00:52:47 2022] DELETE /identity/v3/users/60b069762dbc4b34b23609e4391f52b6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:52:48.203338 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b013a3-9323-4dda-beed-0b766a624ab9 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:48.203665 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b013a3-9323-4dda-beed-0b766a624ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:48.203972 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b013a3-9323-4dda-beed-0b766a624ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:48.264591 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-19b013a3-9323-4dda-beed-0b766a624ab9 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:52:48.265802 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-19b013a3-9323-4dda-beed-0b766a624ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:48.348954 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:48.362820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 762/1508] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:52:48.375211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:48.376497 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:48.482031 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722afdc-46b9-45e6-94f5-837cdc14bd9c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:48.546505 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:48.571028 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa2029-c916-48b2-a817-a59abb97a0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:48.571643 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa2029-c916-48b2-a817-a59abb97a0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:48.571917 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa2029-c916-48b2-a817-a59abb97a0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:48.572204 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa2029-c916-48b2-a817-a59abb97a0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:48.573813 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-ebaa2029-c916-48b2-a817-a59abb97a0c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:48.697455 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa2029-c916-48b2-a817-a59abb97a0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:48.698831 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa2029-c916-48b2-a817-a59abb97a0c7 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:48.718088 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 747/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:52:49.087523 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b013a3-9323-4dda-beed-0b766a624ab9 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:49.088920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-19b013a3-9323-4dda-beed-0b766a624ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:49.100453 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b013a3-9323-4dda-beed-0b766a624ab9 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:49.204075 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:49.204640 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:49.204910 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:49.205178 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] PATH_INFO: `/v3/projects/f0bdbaf4ebad45be91b1e8de297d6d09` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:49.216804 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0bdbaf4ebad45be91b1e8de297d6d09)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:49.217818 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: WARNING py.warnings [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:49.217818 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: warnings.warn(msg) Oct 09 00:52:49.217818 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: Oct 09 00:52:49.219008 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:49.290246 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0bdbaf4ebad45be91b1e8de297d6d09', 'request_id': 'req-3307084e-2491-497c-ac34-681efdaef8b7'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:49.303785 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0bdbaf4ebad45be91b1e8de297d6d09', 'request_id': 'req-3307084e-2491-497c-ac34-681efdaef8b7'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:49.313757 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0bdbaf4ebad45be91b1e8de297d6d09', 'request_id': 'req-3307084e-2491-497c-ac34-681efdaef8b7'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:49.345648 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] The token cache is being invalidate because project f0bdbaf4ebad45be91b1e8de297d6d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:52:49.345937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:49.346358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-3307084e-2491-497c-ac34-681efdaef8b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:49.347787 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 763/1510] 10.222.0.43 () {58 vars in 1233 bytes} [Sun Oct 9 00:52:49 2022] DELETE /identity/v3/projects/f0bdbaf4ebad45be91b1e8de297d6d09 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:52:58.716073 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=62 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:59.343757 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:54:05.710354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b336-a264-4bd4-b529-1633accc4270 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:05.711017 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b336-a264-4bd4-b529-1633accc4270 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:05.711199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b336-a264-4bd4-b529-1633accc4270 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:05.713147 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:54:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:05.718717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7218543-26ac-4dcf-8f4a-d3141fad0449 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:05.719250 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7218543-26ac-4dcf-8f4a-d3141fad0449 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:05.719250 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7218543-26ac-4dcf-8f4a-d3141fad0449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:05.821741 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-c7218543-26ac-4dcf-8f4a-d3141fad0449 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:05.822959 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-c7218543-26ac-4dcf-8f4a-d3141fad0449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:05.992168 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:06.174134 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b336-a264-4bd4-b529-1633accc4270 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:06.179138 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7c44b336-a264-4bd4-b529-1633accc4270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:06.352982 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b336-a264-4bd4-b529-1633accc4270 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:06.359615 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1b896-95f1-424c-8b56-49c2dd0229be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:06.360264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1b896-95f1-424c-8b56-49c2dd0229be service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:06.360542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1b896-95f1-424c-8b56-49c2dd0229be service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:06.360809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1b896-95f1-424c-8b56-49c2dd0229be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:06.370403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1b896-95f1-424c-8b56-49c2dd0229be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:06.372433 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1b896-95f1-424c-8b56-49c2dd0229be service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:06.387862 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 749/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:07.484382 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df376a2-fc8c-43ad-a75b-35b861a0a0ae None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:07.485300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df376a2-fc8c-43ad-a75b-35b861a0a0ae None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:07.485300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df376a2-fc8c-43ad-a75b-35b861a0a0ae None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:07.487305 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:54:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:07.497708 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58538adf-d72a-46b7-a5ff-94c896e46420 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:07.498197 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58538adf-d72a-46b7-a5ff-94c896e46420 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:07.498309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58538adf-d72a-46b7-a5ff-94c896e46420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:07.523917 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-58538adf-d72a-46b7-a5ff-94c896e46420 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:07.525158 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-58538adf-d72a-46b7-a5ff-94c896e46420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:07.534566 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:07.694585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df376a2-fc8c-43ad-a75b-35b861a0a0ae None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:07.711702 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df376a2-fc8c-43ad-a75b-35b861a0a0ae None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:07.719752 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fadbd-49fb-4574-bb2a-9d462f3be534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:07.720378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fadbd-49fb-4574-bb2a-9d462f3be534 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:07.720652 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fadbd-49fb-4574-bb2a-9d462f3be534 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:07.720946 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fadbd-49fb-4574-bb2a-9d462f3be534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:07.730501 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fadbd-49fb-4574-bb2a-9d462f3be534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:07.732170 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fadbd-49fb-4574-bb2a-9d462f3be534 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:07.741891 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 766/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:54:09.676901 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc61ce-3976-4653-9d3e-59621bf9a03c None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:09.677643 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc61ce-3976-4653-9d3e-59621bf9a03c None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:09.677643 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc61ce-3976-4653-9d3e-59621bf9a03c None None] PATH_INFO: `/v3` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:09.679117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 751/1517] 10.222.0.20 () {54 vars in 925 bytes} [Sun Oct 9 00:54:09 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:54:09.687266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fceb1d-eb91-48d0-8d50-7387cbfda8e8 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:09.687761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fceb1d-eb91-48d0-8d50-7387cbfda8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:09.687761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fceb1d-eb91-48d0-8d50-7387cbfda8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:09.757316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-82fceb1d-eb91-48d0-8d50-7387cbfda8e8 None None] MFA Rules not processed for user `536ebcc364834a75beefab0f2b0cc196`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:09.758584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-82fceb1d-eb91-48d0-8d50-7387cbfda8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:09.781915 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:54:09.844187 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 767/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Oct 9 00:54:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:17.518875 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=56 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:54:18.222773 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d616f4d-5c01-41fb-87d1-02650bfce5a7 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:18.223034 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d616f4d-5c01-41fb-87d1-02650bfce5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:18.223284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d616f4d-5c01-41fb-87d1-02650bfce5a7 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:18.224669 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 752/1519] 10.222.0.43 () {54 vars in 961 bytes} [Sun Oct 9 00:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:18.229788 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8902d-5a41-4523-8d14-4faebd68b941 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:18.230302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8902d-5a41-4523-8d14-4faebd68b941 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:18.230302 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8902d-5a41-4523-8d14-4faebd68b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:18.252478 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-29e8902d-5a41-4523-8d14-4faebd68b941 None None] MFA Rules not processed for user `536ebcc364834a75beefab0f2b0cc196`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:18.253663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-29e8902d-5a41-4523-8d14-4faebd68b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:18.262612 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 768/1520] 10.222.0.43 () {58 vars in 1058 bytes} [Sun Oct 9 00:54:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:18.270091 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d616f4d-5c01-41fb-87d1-02650bfce5a7 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:18.286566 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d616f4d-5c01-41fb-87d1-02650bfce5a7 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:18.291494 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdf558-418b-446a-a7df-ea5f5954c1c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536ebcc364834a75beefab0f2b0cc196', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:18.292121 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdf558-418b-446a-a7df-ea5f5954c1c5 service placement] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:18.292394 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdf558-418b-446a-a7df-ea5f5954c1c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:18.292659 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdf558-418b-446a-a7df-ea5f5954c1c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:18.301169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdf558-418b-446a-a7df-ea5f5954c1c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:18.302755 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdf558-418b-446a-a7df-ea5f5954c1c5 service placement] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:18.312714 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 753/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:19.226486 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883888f-4e17-4183-9894-59878a03813a None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:19.226783 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883888f-4e17-4183-9894-59878a03813a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:19.227093 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883888f-4e17-4183-9894-59878a03813a None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:19.229055 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:19.236342 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e33fa-4519-461f-941a-e4c9aae9c818 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:19.236856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e33fa-4519-461f-941a-e4c9aae9c818 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:19.236977 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e33fa-4519-461f-941a-e4c9aae9c818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:19.267169 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-014e33fa-4519-461f-941a-e4c9aae9c818 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:19.268407 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-014e33fa-4519-461f-941a-e4c9aae9c818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:19.279333 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:19.442845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883888f-4e17-4183-9894-59878a03813a None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:19.458942 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883888f-4e17-4183-9894-59878a03813a None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:19.464778 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb348-3b38-4f9e-b180-5880f8505565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:19.465603 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb348-3b38-4f9e-b180-5880f8505565 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:19.465948 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb348-3b38-4f9e-b180-5880f8505565 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:19.466204 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb348-3b38-4f9e-b180-5880f8505565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:19.474266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb348-3b38-4f9e-b180-5880f8505565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:19.475862 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb348-3b38-4f9e-b180-5880f8505565 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:19.485648 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 770/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:20.553760 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107c05d-5d98-4f2a-ab70-4b26b4b28c70 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:20.554666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107c05d-5d98-4f2a-ab70-4b26b4b28c70 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:20.554666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107c05d-5d98-4f2a-ab70-4b26b4b28c70 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:20.556834 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:54:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:20.565868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee754694-25aa-42b2-b35d-86217039d9a8 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:20.566374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee754694-25aa-42b2-b35d-86217039d9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:20.566374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee754694-25aa-42b2-b35d-86217039d9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:20.588971 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-ee754694-25aa-42b2-b35d-86217039d9a8 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:20.590267 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-ee754694-25aa-42b2-b35d-86217039d9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:20.599409 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:54:20.756014 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107c05d-5d98-4f2a-ab70-4b26b4b28c70 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:20.773930 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107c05d-5d98-4f2a-ab70-4b26b4b28c70 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:20.779968 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd428ab-a6d0-4a64-8273-652fa67f3a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:20.780603 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd428ab-a6d0-4a64-8273-652fa67f3a5f service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:20.780881 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd428ab-a6d0-4a64-8273-652fa67f3a5f service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:20.781155 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd428ab-a6d0-4a64-8273-652fa67f3a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:20.790036 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd428ab-a6d0-4a64-8273-652fa67f3a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:20.791662 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd428ab-a6d0-4a64-8273-652fa67f3a5f service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:20.802335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 756/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:25.151068 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed6886-da72-4861-a4fc-2f91d6c8a41e None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:25.151923 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed6886-da72-4861-a4fc-2f91d6c8a41e None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:25.151923 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed6886-da72-4861-a4fc-2f91d6c8a41e None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:25.153962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:54:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:25.162772 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731ee5-aac1-4633-be16-57596ca5e483 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:25.163221 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731ee5-aac1-4633-be16-57596ca5e483 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:25.163358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731ee5-aac1-4633-be16-57596ca5e483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:25.191457 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-23731ee5-aac1-4633-be16-57596ca5e483 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:25.193247 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-23731ee5-aac1-4633-be16-57596ca5e483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:25.204405 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:25.503177 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed6886-da72-4861-a4fc-2f91d6c8a41e None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:25.505088 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-a6ed6886-da72-4861-a4fc-2f91d6c8a41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:25.589021 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed6886-da72-4861-a4fc-2f91d6c8a41e None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:25.593098 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c1796-da9c-4566-b5d7-e731f59dfd41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:25.593692 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c1796-da9c-4566-b5d7-e731f59dfd41 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:25.593962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c1796-da9c-4566-b5d7-e731f59dfd41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:25.594224 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c1796-da9c-4566-b5d7-e731f59dfd41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:25.603242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c1796-da9c-4566-b5d7-e731f59dfd41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:25.604697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c1796-da9c-4566-b5d7-e731f59dfd41 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:25.614805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 773/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:27.756230 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6c9d0-f9b1-40b2-99a6-97043d55536a None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:27.757565 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6c9d0-f9b1-40b2-99a6-97043d55536a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:27.757565 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6c9d0-f9b1-40b2-99a6-97043d55536a None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:27.760023 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:54:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:27.768282 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c35824-d62c-4fe5-ba49-d94e5101ae5f None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:27.768752 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c35824-d62c-4fe5-ba49-d94e5101ae5f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:27.768846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c35824-d62c-4fe5-ba49-d94e5101ae5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:27.791893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-e9c35824-d62c-4fe5-ba49-d94e5101ae5f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:27.793458 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e9c35824-d62c-4fe5-ba49-d94e5101ae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:27.802642 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:54:28.092908 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6c9d0-f9b1-40b2-99a6-97043d55536a None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:28.095552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e2f6c9d0-f9b1-40b2-99a6-97043d55536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:28.113342 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6c9d0-f9b1-40b2-99a6-97043d55536a None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:28.117275 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f256854-dff7-4436-9894-6159bea8c818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:28.117870 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256854-dff7-4436-9894-6159bea8c818 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:28.118143 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256854-dff7-4436-9894-6159bea8c818 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:28.118411 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256854-dff7-4436-9894-6159bea8c818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:28.128139 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f256854-dff7-4436-9894-6159bea8c818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:28.129512 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f256854-dff7-4436-9894-6159bea8c818 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:28.139069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 759/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:54:32.146111 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83782c-efd1-436c-974f-84976a2bda9a None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:32.146696 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83782c-efd1-436c-974f-84976a2bda9a None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:32.146696 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83782c-efd1-436c-974f-84976a2bda9a None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:32.148059 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:32.153477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09558e90-096c-4b2c-b25b-8b54170047d0 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:32.153938 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09558e90-096c-4b2c-b25b-8b54170047d0 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:32.154035 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09558e90-096c-4b2c-b25b-8b54170047d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:32.173924 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-09558e90-096c-4b2c-b25b-8b54170047d0 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:32.175115 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-09558e90-096c-4b2c-b25b-8b54170047d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:32.182868 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:32.489731 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83782c-efd1-436c-974f-84976a2bda9a None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:32.493107 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3c83782c-efd1-436c-974f-84976a2bda9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:32.564745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:54:32.583220 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83782c-efd1-436c-974f-84976a2bda9a None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:32.588735 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a098cd-259b-4d80-867e-fcfe36dfa09b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44cd61c1bfd4ed29e7ede8f8e3a22be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:32.589353 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a098cd-259b-4d80-867e-fcfe36dfa09b service cinder] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:32.589628 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a098cd-259b-4d80-867e-fcfe36dfa09b service cinder] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:32.589958 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a098cd-259b-4d80-867e-fcfe36dfa09b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:32.599516 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a098cd-259b-4d80-867e-fcfe36dfa09b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:32.600978 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a098cd-259b-4d80-867e-fcfe36dfa09b service cinder] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:32.610964 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 776/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:34.713774 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906660e-09b4-4d79-86cd-1cc8550614cc None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:34.714614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906660e-09b4-4d79-86cd-1cc8550614cc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:34.714614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906660e-09b4-4d79-86cd-1cc8550614cc None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:34.716090 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:34.721682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb402a-f386-4409-9f12-4d85a80f9f2b None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:34.722141 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb402a-f386-4409-9f12-4d85a80f9f2b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:34.722250 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb402a-f386-4409-9f12-4d85a80f9f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:34.742544 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-8fbb402a-f386-4409-9f12-4d85a80f9f2b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:34.743746 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-8fbb402a-f386-4409-9f12-4d85a80f9f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:34.752903 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:35.059487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906660e-09b4-4d79-86cd-1cc8550614cc None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:35.062766 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f906660e-09b4-4d79-86cd-1cc8550614cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:35.082729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906660e-09b4-4d79-86cd-1cc8550614cc None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:35.087483 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16281c2-4e65-41d3-b438-9c328abda040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44cd61c1bfd4ed29e7ede8f8e3a22be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:35.088079 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16281c2-4e65-41d3-b438-9c328abda040 service cinder] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:35.088392 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16281c2-4e65-41d3-b438-9c328abda040 service cinder] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:35.088661 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16281c2-4e65-41d3-b438-9c328abda040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:35.099820 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16281c2-4e65-41d3-b438-9c328abda040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:35.102056 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16281c2-4e65-41d3-b438-9c328abda040 service cinder] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:35.113286 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 762/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:44.737644 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=11 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:54:45.109247 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=33 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:52.683133 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400cc64-d4b3-48c1-805a-9c2fb96d8f50 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.683820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400cc64-d4b3-48c1-805a-9c2fb96d8f50 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.683820 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400cc64-d4b3-48c1-805a-9c2fb96d8f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.704168 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb94ea-a138-44a1-9c8a-43d695f0744b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.705053 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-e400cc64-d4b3-48c1-805a-9c2fb96d8f50 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:52.705250 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb94ea-a138-44a1-9c8a-43d695f0744b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.705400 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb94ea-a138-44a1-9c8a-43d695f0744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.706263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e400cc64-d4b3-48c1-805a-9c2fb96d8f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:52.714581 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 778/1540] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:52.722659 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57686-d626-4a8f-a53e-09b3d51b8638 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.722940 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57686-d626-4a8f-a53e-09b3d51b8638 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.723210 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57686-d626-4a8f-a53e-09b3d51b8638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.726829 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-96bb94ea-a138-44a1-9c8a-43d695f0744b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:52.728033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-96bb94ea-a138-44a1-9c8a-43d695f0744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:52.736592 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 763/1541] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:55:52.744287 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-27e57686-d626-4a8f-a53e-09b3d51b8638 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:52.745075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961af3-deb0-4f87-a739-4be868dece2b None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.745360 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961af3-deb0-4f87-a739-4be868dece2b None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.745463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-27e57686-d626-4a8f-a53e-09b3d51b8638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:52.745630 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961af3-deb0-4f87-a739-4be868dece2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.754171 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 779/1542] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:55:52.758545 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e57686-d626-4a8f-a53e-09b3d51b8638 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:52.767847 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e57686-d626-4a8f-a53e-09b3d51b8638 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:52.769200 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-06961af3-deb0-4f87-a739-4be868dece2b None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:52.770394 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-06961af3-deb0-4f87-a739-4be868dece2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:52.776260 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4355dff-7abd-4697-acf6-ccecaace7246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:52.776867 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355dff-7abd-4697-acf6-ccecaace7246 admin admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.777143 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355dff-7abd-4697-acf6-ccecaace7246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.777546 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355dff-7abd-4697-acf6-ccecaace7246 admin admin] PATH_INFO: `/v3/domains` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.778350 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4355dff-7abd-4697-acf6-ccecaace7246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:55:52.778646 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4355dff-7abd-4697-acf6-ccecaace7246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:52.779530 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 764/1543] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:55:52.783139 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4355dff-7abd-4697-acf6-ccecaace7246 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:52.784080 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06961af3-deb0-4f87-a739-4be868dece2b None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:52.793443 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06961af3-deb0-4f87-a739-4be868dece2b None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:52.796774 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 780/1544] 10.222.0.43 () {58 vars in 1153 bytes} [Sun Oct 9 00:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:55:52.798663 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777854a-d753-4afc-8152-093a4086730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:52.799308 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777854a-d753-4afc-8152-093a4086730c admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.799613 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777854a-d753-4afc-8152-093a4086730c admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.799882 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777854a-d753-4afc-8152-093a4086730c admin admin] PATH_INFO: `/v3/domains` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.800637 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777854a-d753-4afc-8152-093a4086730c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:55:52.800938 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777854a-d753-4afc-8152-093a4086730c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:52.801966 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: WARNING py.warnings [None req-3777854a-d753-4afc-8152-093a4086730c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:55:52.801966 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: warnings.warn(msg) Oct 09 00:55:52.801966 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: Oct 09 00:55:52.802856 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777854a-d753-4afc-8152-093a4086730c admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:52.804622 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4355dff-7abd-4697-acf6-ccecaace7246 admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:52.814531 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4355dff-7abd-4697-acf6-ccecaace7246 admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:52.822434 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 765/1545] 10.222.0.43 () {58 vars in 1153 bytes} [Sun Oct 9 00:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:55:52.822602 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04791b8d-04b9-4d00-8c93-3e1800f765bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:52.822602 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791b8d-04b9-4d00-8c93-3e1800f765bc admin admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.822602 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791b8d-04b9-4d00-8c93-3e1800f765bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.822602 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791b8d-04b9-4d00-8c93-3e1800f765bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.822981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04791b8d-04b9-4d00-8c93-3e1800f765bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:52.822981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: WARNING py.warnings [None req-04791b8d-04b9-4d00-8c93-3e1800f765bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:55:52.822981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: warnings.warn(msg) Oct 09 00:55:52.822981 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: Oct 09 00:55:52.823317 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04791b8d-04b9-4d00-8c93-3e1800f765bc admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:52.824809 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777854a-d753-4afc-8152-093a4086730c admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:52.836414 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777854a-d753-4afc-8152-093a4086730c admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:52.841322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013b59e-44a1-4e16-a97c-16d0abda2592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:52.841923 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013b59e-44a1-4e16-a97c-16d0abda2592 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.842199 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013b59e-44a1-4e16-a97c-16d0abda2592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.842471 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013b59e-44a1-4e16-a97c-16d0abda2592 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.843094 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013b59e-44a1-4e16-a97c-16d0abda2592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:52.845047 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013b59e-44a1-4e16-a97c-16d0abda2592 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:52.864027 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 781/1546] 10.222.0.43 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:52 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:55:52.868627 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04791b8d-04b9-4d00-8c93-3e1800f765bc admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:52.873318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 766/1547] 10.222.0.43 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:52 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:55:52.877608 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013b59e-44a1-4e16-a97c-16d0abda2592 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:52.936465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04791b8d-04b9-4d00-8c93-3e1800f765bc admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:52.938122 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013b59e-44a1-4e16-a97c-16d0abda2592 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:52.941492 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bb18e-6843-4758-be47-0f07de1aff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:52.942194 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bb18e-6843-4758-be47-0f07de1aff76 admin admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.942472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bb18e-6843-4758-be47-0f07de1aff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.942739 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bb18e-6843-4758-be47-0f07de1aff76 admin admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.942845 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adbed5-0bbd-4159-b03e-a2225e865429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:52.943366 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bb18e-6843-4758-be47-0f07de1aff76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:52.943475 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adbed5-0bbd-4159-b03e-a2225e865429 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.943666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adbed5-0bbd-4159-b03e-a2225e865429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.943934 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adbed5-0bbd-4159-b03e-a2225e865429 admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.944588 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adbed5-0bbd-4159-b03e-a2225e865429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:52.945308 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bb18e-6843-4758-be47-0f07de1aff76 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:52.945600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: WARNING py.warnings [None req-02adbed5-0bbd-4159-b03e-a2225e865429 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:55:52.945600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: warnings.warn(msg) Oct 09 00:55:52.945600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: Oct 09 00:55:52.946797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adbed5-0bbd-4159-b03e-a2225e865429 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:52.971405 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 782/1548] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:52 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:55:52.971627 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 767/1549] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:52 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:55:52.972623 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bb18e-6843-4758-be47-0f07de1aff76 admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:52.973790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adbed5-0bbd-4159-b03e-a2225e865429 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:52.982767 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bb18e-6843-4758-be47-0f07de1aff76 admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:52.983356 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adbed5-0bbd-4159-b03e-a2225e865429 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:52.987722 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe12ee-f475-420d-acbe-ec6bfc2a9058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:52.988162 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a547077-89d2-453c-ab61-15501f3a925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:52.988349 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe12ee-f475-420d-acbe-ec6bfc2a9058 admin admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.988627 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe12ee-f475-420d-acbe-ec6bfc2a9058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.988739 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a547077-89d2-453c-ab61-15501f3a925f admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:52.988900 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe12ee-f475-420d-acbe-ec6bfc2a9058 admin admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.988997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a547077-89d2-453c-ab61-15501f3a925f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:52.989262 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a547077-89d2-453c-ab61-15501f3a925f admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:52.989538 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe12ee-f475-420d-acbe-ec6bfc2a9058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:52.989894 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a547077-89d2-453c-ab61-15501f3a925f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:52.991170 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe12ee-f475-420d-acbe-ec6bfc2a9058 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:52.991482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a547077-89d2-453c-ab61-15501f3a925f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:53.002365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 768/1550] 10.222.0.43 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:55:53.002650 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 783/1551] 10.222.0.43 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:53.006374 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe12ee-f475-420d-acbe-ec6bfc2a9058 admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:53.006537 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a547077-89d2-453c-ab61-15501f3a925f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:53.016342 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe12ee-f475-420d-acbe-ec6bfc2a9058 admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:53.016552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a547077-89d2-453c-ab61-15501f3a925f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:53.021069 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9549296-1f53-4a43-9869-567cbacde331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:53.021230 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fe91e-ef21-48a5-b5ab-379994704e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:53.021651 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549296-1f53-4a43-9869-567cbacde331 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:53.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fe91e-ef21-48a5-b5ab-379994704e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:53.021932 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549296-1f53-4a43-9869-567cbacde331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:53.022092 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fe91e-ef21-48a5-b5ab-379994704e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:53.022196 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549296-1f53-4a43-9869-567cbacde331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:53.022367 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fe91e-ef21-48a5-b5ab-379994704e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:53.022810 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9549296-1f53-4a43-9869-567cbacde331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:53.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fe91e-ef21-48a5-b5ab-379994704e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:53.024480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9549296-1f53-4a43-9869-567cbacde331 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:53.024620 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fe91e-ef21-48a5-b5ab-379994704e43 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:53.036063 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 769/1552] 10.222.0.43 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:53.039312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 784/1553] 10.222.0.43 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:53.040267 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fe91e-ef21-48a5-b5ab-379994704e43 admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:53.040385 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9549296-1f53-4a43-9869-567cbacde331 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:53.050284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9549296-1f53-4a43-9869-567cbacde331 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:53.050464 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fe91e-ef21-48a5-b5ab-379994704e43 admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:53.054975 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ae22e-d771-49c5-83e6-a3e2ebd79b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:53.055561 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35c44e-c1b6-4376-a8d7-d4f385cafaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:53.055694 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae22e-d771-49c5-83e6-a3e2ebd79b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:53.055880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae22e-d771-49c5-83e6-a3e2ebd79b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:53.056187 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae22e-d771-49c5-83e6-a3e2ebd79b24 admin admin] PATH_INFO: `/v3/projects/f1a4add361e141ccafc5fa597e521055/users/6c06cf5d26e4459a9cf7a023beb2e3ea/roles/fa4a34a109e44660bbce4320a4c9a366` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:53.056311 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c44e-c1b6-4376-a8d7-d4f385cafaa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:53.056493 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c44e-c1b6-4376-a8d7-d4f385cafaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:53.056755 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c44e-c1b6-4376-a8d7-d4f385cafaa5 admin admin] PATH_INFO: `/v3/projects/9b952be6d0784abdb2e25b8389a401aa/users/67277a3f967142b3a4166e3acbd88fc7/roles/fa4a34a109e44660bbce4320a4c9a366` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:53.071335 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35c44e-c1b6-4376-a8d7-d4f385cafaa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b952be6d0784abdb2e25b8389a401aa, user_id=67277a3f967142b3a4166e3acbd88fc7, role_id=fa4a34a109e44660bbce4320a4c9a366)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:53.071535 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ae22e-d771-49c5-83e6-a3e2ebd79b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a4add361e141ccafc5fa597e521055, user_id=6c06cf5d26e4459a9cf7a023beb2e3ea, role_id=fa4a34a109e44660bbce4320a4c9a366)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:53.072389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: WARNING py.warnings [None req-fa35c44e-c1b6-4376-a8d7-d4f385cafaa5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:55:53.072389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: warnings.warn(msg) Oct 09 00:55:53.072389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: Oct 09 00:55:53.074287 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ae22e-d771-49c5-83e6-a3e2ebd79b24 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:53.074452 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35c44e-c1b6-4376-a8d7-d4f385cafaa5 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:53.089195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 770/1554] 10.222.0.43 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:53 2022] PUT /identity/v3/projects/f1a4add361e141ccafc5fa597e521055/users/6c06cf5d26e4459a9cf7a023beb2e3ea/roles/fa4a34a109e44660bbce4320a4c9a366 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:55:53.090008 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 785/1555] 10.222.0.43 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:53 2022] PUT /identity/v3/projects/9b952be6d0784abdb2e25b8389a401aa/users/67277a3f967142b3a4166e3acbd88fc7/roles/fa4a34a109e44660bbce4320a4c9a366 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:55:53.094634 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b61ff-8444-4584-ba52-e99bdce317a4 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:53.094920 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b61ff-8444-4584-ba52-e99bdce317a4 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:53.095102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0747d-7198-4f7b-a86e-bd605c96de9f None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:53.095211 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b61ff-8444-4584-ba52-e99bdce317a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:53.095388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0747d-7198-4f7b-a86e-bd605c96de9f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:53.095661 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0747d-7198-4f7b-a86e-bd605c96de9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:53.115296 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-cf4b61ff-8444-4584-ba52-e99bdce317a4 None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:53.116538 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cf4b61ff-8444-4584-ba52-e99bdce317a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:53.117976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-87b0747d-7198-4f7b-a86e-bd605c96de9f None None] MFA Rules not processed for user `98027de25a1b4edcab7ee4843ee0a448`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:53.119153 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-87b0747d-7198-4f7b-a86e-bd605c96de9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:53.161116 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:53.165419 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:53.177469 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 771/1556] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:55:53.182112 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 786/1557] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:53.194726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b61ff-8444-4584-ba52-e99bdce317a4 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:53.194866 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0747d-7198-4f7b-a86e-bd605c96de9f None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:53.250119 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0747d-7198-4f7b-a86e-bd605c96de9f None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:53.250388 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b61ff-8444-4584-ba52-e99bdce317a4 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:53.254019 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f614ec4-207e-49bc-806c-9134532194e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:53.254322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954c289-22ae-4583-ba38-28d7b0d956d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:53.254625 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f614ec4-207e-49bc-806c-9134532194e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:53.254903 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f614ec4-207e-49bc-806c-9134532194e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:53.255019 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954c289-22ae-4583-ba38-28d7b0d956d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:53.255172 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f614ec4-207e-49bc-806c-9134532194e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:53.255294 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954c289-22ae-4583-ba38-28d7b0d956d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:53.255463 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954c289-22ae-4583-ba38-28d7b0d956d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:53.264640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f614ec4-207e-49bc-806c-9134532194e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:53.264947 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954c289-22ae-4583-ba38-28d7b0d956d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:53.266144 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f614ec4-207e-49bc-806c-9134532194e0 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:53.266376 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954c289-22ae-4583-ba38-28d7b0d956d6 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:53.275821 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 772/1559] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:55:53.276081 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 787/1559] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:55:58.590495 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed2ba-0aac-48ca-976e-31246efca83a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.591135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed2ba-0aac-48ca-976e-31246efca83a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.591135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed2ba-0aac-48ca-976e-31246efca83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.648026 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0dfed2ba-0aac-48ca-976e-31246efca83a None None] MFA Rules not processed for user `67277a3f967142b3a4166e3acbd88fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:58.650333 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0dfed2ba-0aac-48ca-976e-31246efca83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:58.757987 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 773/1560] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:58.759132 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954c289-22ae-4583-ba38-28d7b0d956d6 service neutron] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.770200 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954c289-22ae-4583-ba38-28d7b0d956d6 service neutron] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.776322 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcf914-bd84-406f-a0fb-58ef5cb8c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.777235 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf914-bd84-406f-a0fb-58ef5cb8c9cc admin admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.777759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf914-bd84-406f-a0fb-58ef5cb8c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf914-bd84-406f-a0fb-58ef5cb8c9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.779092 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcf914-bd84-406f-a0fb-58ef5cb8c9cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.781155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcf914-bd84-406f-a0fb-58ef5cb8c9cc admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.837662 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149731-c65b-4e04-adfe-d3ca6a66a7a3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.837993 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149731-c65b-4e04-adfe-d3ca6a66a7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.838263 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149731-c65b-4e04-adfe-d3ca6a66a7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.855112 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 788/1561] 10.222.0.43 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:55:58.859616 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcf914-bd84-406f-a0fb-58ef5cb8c9cc admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.890013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-2e149731-c65b-4e04-adfe-d3ca6a66a7a3 None None] MFA Rules not processed for user `6c06cf5d26e4459a9cf7a023beb2e3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:58.896813 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-2e149731-c65b-4e04-adfe-d3ca6a66a7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:58.942028 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcf914-bd84-406f-a0fb-58ef5cb8c9cc admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.947529 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebec292-2450-4329-9415-97f8b305139a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.948120 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebec292-2450-4329-9415-97f8b305139a admin admin] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.948393 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebec292-2450-4329-9415-97f8b305139a admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.948657 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebec292-2450-4329-9415-97f8b305139a admin admin] PATH_INFO: `/v3/users` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.949472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebec292-2450-4329-9415-97f8b305139a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.951456 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebec292-2450-4329-9415-97f8b305139a admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.978084 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 789/1562] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:55:58.982092 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebec292-2450-4329-9415-97f8b305139a admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.986712 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 774/1563] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:55:58.991235 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149731-c65b-4e04-adfe-d3ca6a66a7a3 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebec292-2450-4329-9415-97f8b305139a admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.000811 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b55ed-f1bb-49db-824a-a657b5084086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.001505 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b55ed-f1bb-49db-824a-a657b5084086 admin admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.001850 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b55ed-f1bb-49db-824a-a657b5084086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.002192 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b55ed-f1bb-49db-824a-a657b5084086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.002901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b55ed-f1bb-49db-824a-a657b5084086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.004665 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b55ed-f1bb-49db-824a-a657b5084086 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.007406 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149731-c65b-4e04-adfe-d3ca6a66a7a3 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.013528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a870748-063b-4e41-853c-d5300c320f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.014445 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a870748-063b-4e41-853c-d5300c320f46 admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.014896 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a870748-063b-4e41-853c-d5300c320f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.015358 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a870748-063b-4e41-853c-d5300c320f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.016190 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a870748-063b-4e41-853c-d5300c320f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.018394 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a870748-063b-4e41-853c-d5300c320f46 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.022382 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 790/1564] 10.222.0.43 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:59.030273 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b55ed-f1bb-49db-824a-a657b5084086 admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.040953 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:59.042693 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b55ed-f1bb-49db-824a-a657b5084086 admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.048664 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e72a21-a4c5-46bd-9315-7869ad5922b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.049393 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e72a21-a4c5-46bd-9315-7869ad5922b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.049680 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e72a21-a4c5-46bd-9315-7869ad5922b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.050018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e72a21-a4c5-46bd-9315-7869ad5922b9 admin admin] PATH_INFO: `/v3/projects/4276506b1fe045289bd5696a88852f7c/users/6ee29f7245574666b1f6b09e7c0911d9/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.060800 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 775/1565] 10.222.0.43 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:55:59.068614 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a870748-063b-4e41-853c-d5300c320f46 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.070934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e72a21-a4c5-46bd-9315-7869ad5922b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4276506b1fe045289bd5696a88852f7c, user_id=6ee29f7245574666b1f6b09e7c0911d9, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.073725 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e72a21-a4c5-46bd-9315-7869ad5922b9 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.090633 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 791/1566] 10.222.0.43 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:59 2022] PUT /identity/v3/projects/4276506b1fe045289bd5696a88852f7c/users/6ee29f7245574666b1f6b09e7c0911d9/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:55:59.094721 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e72a21-a4c5-46bd-9315-7869ad5922b9 admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.122994 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:59.157847 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a870748-063b-4e41-853c-d5300c320f46 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.163514 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2ce90-3547-410f-a303-05742ad1434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.164430 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2ce90-3547-410f-a303-05742ad1434f admin admin] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.164712 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2ce90-3547-410f-a303-05742ad1434f admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.164980 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2ce90-3547-410f-a303-05742ad1434f admin admin] PATH_INFO: `/v3/users` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.165615 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2ce90-3547-410f-a303-05742ad1434f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.166528 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e72a21-a4c5-46bd-9315-7869ad5922b9 admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.167714 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2ce90-3547-410f-a303-05742ad1434f admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.171654 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0de95-6723-424b-9471-d6cf4d5459fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.172360 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0de95-6723-424b-9471-d6cf4d5459fb admin admin] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.172701 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0de95-6723-424b-9471-d6cf4d5459fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.173033 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0de95-6723-424b-9471-d6cf4d5459fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.173761 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0de95-6723-424b-9471-d6cf4d5459fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.175410 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0de95-6723-424b-9471-d6cf4d5459fb admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.192155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 792/1567] 10.222.0.43 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:59.193421 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0de95-6723-424b-9471-d6cf4d5459fb admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.201145 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 776/1568] 10.222.0.43 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:59 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:59.203096 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2ce90-3547-410f-a303-05742ad1434f admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.205723 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0de95-6723-424b-9471-d6cf4d5459fb admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.211150 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a1749-cac5-412b-b131-30df8a5c2df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.212226 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a1749-cac5-412b-b131-30df8a5c2df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.212499 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a1749-cac5-412b-b131-30df8a5c2df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.212768 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a1749-cac5-412b-b131-30df8a5c2df7 admin admin] PATH_INFO: `/v3/projects/4276506b1fe045289bd5696a88852f7c/users/6ee29f7245574666b1f6b09e7c0911d9/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.216799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2ce90-3547-410f-a303-05742ad1434f admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.217522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a1749-cac5-412b-b131-30df8a5c2df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4276506b1fe045289bd5696a88852f7c, user_id=6ee29f7245574666b1f6b09e7c0911d9, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.220697 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a1749-cac5-412b-b131-30df8a5c2df7 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.221280 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b23f8e-f47e-4723-bac1-bb39d747f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.222158 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b23f8e-f47e-4723-bac1-bb39d747f369 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.222483 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b23f8e-f47e-4723-bac1-bb39d747f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.222633 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b23f8e-f47e-4723-bac1-bb39d747f369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.223639 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b23f8e-f47e-4723-bac1-bb39d747f369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.226486 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b23f8e-f47e-4723-bac1-bb39d747f369 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.235584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 793/1569] 10.222.0.43 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:59 2022] PUT /identity/v3/projects/4276506b1fe045289bd5696a88852f7c/users/6ee29f7245574666b1f6b09e7c0911d9/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:55:59.240932 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 777/1570] 10.222.0.43 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:55:59.242930 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a1749-cac5-412b-b131-30df8a5c2df7 admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.321034 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a1749-cac5-412b-b131-30df8a5c2df7 admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.331405 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044c4fa-e1a3-43e1-8d2e-110c771506c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.332666 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c4fa-e1a3-43e1-8d2e-110c771506c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.332948 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c4fa-e1a3-43e1-8d2e-110c771506c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.333720 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c4fa-e1a3-43e1-8d2e-110c771506c9 admin admin] PATH_INFO: `/v3/projects/9cbec505bba946e28a7e9e3400aff280/users/2b89bb10b0f248a5a46690bc68790ead/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.353000 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044c4fa-e1a3-43e1-8d2e-110c771506c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbec505bba946e28a7e9e3400aff280, user_id=2b89bb10b0f248a5a46690bc68790ead, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.357189 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044c4fa-e1a3-43e1-8d2e-110c771506c9 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.374585 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 794/1571] 10.222.0.43 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:59 2022] PUT /identity/v3/projects/9cbec505bba946e28a7e9e3400aff280/users/2b89bb10b0f248a5a46690bc68790ead/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:55:59.375610 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b23f8e-f47e-4723-bac1-bb39d747f369 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.387403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b23f8e-f47e-4723-bac1-bb39d747f369 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.462451 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30385f1c-3381-489f-bfe3-fc8803abfa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.463335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30385f1c-3381-489f-bfe3-fc8803abfa37 admin admin] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.463774 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30385f1c-3381-489f-bfe3-fc8803abfa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.464256 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30385f1c-3381-489f-bfe3-fc8803abfa37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.465109 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30385f1c-3381-489f-bfe3-fc8803abfa37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.467178 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30385f1c-3381-489f-bfe3-fc8803abfa37 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.482552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 778/1572] 10.222.0.43 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:59.486168 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044c4fa-e1a3-43e1-8d2e-110c771506c9 admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.497394 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044c4fa-e1a3-43e1-8d2e-110c771506c9 admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.501976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0aafc-94ed-45b0-bf9d-421d054a3b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.502701 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0aafc-94ed-45b0-bf9d-421d054a3b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.503037 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0aafc-94ed-45b0-bf9d-421d054a3b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.503388 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0aafc-94ed-45b0-bf9d-421d054a3b39 admin admin] PATH_INFO: `/v3/projects/9cbec505bba946e28a7e9e3400aff280/users/2b89bb10b0f248a5a46690bc68790ead/roles/3ecd48367a4144eda99e3e0ca7e4748f` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.513674 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0aafc-94ed-45b0-bf9d-421d054a3b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbec505bba946e28a7e9e3400aff280, user_id=2b89bb10b0f248a5a46690bc68790ead, role_id=3ecd48367a4144eda99e3e0ca7e4748f)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.528512 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0aafc-94ed-45b0-bf9d-421d054a3b39 admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.546830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 795/1573] 10.222.0.43 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:59 2022] PUT /identity/v3/projects/9cbec505bba946e28a7e9e3400aff280/users/2b89bb10b0f248a5a46690bc68790ead/roles/3ecd48367a4144eda99e3e0ca7e4748f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:56:06.774729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d8a2f-61c2-4442-ae11-b710b89b82ec None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:06.775628 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d8a2f-61c2-4442-ae11-b710b89b82ec None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:06.776030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d8a2f-61c2-4442-ae11-b710b89b82ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:06.820718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-206d8a2f-61c2-4442-ae11-b710b89b82ec None None] MFA Rules not processed for user `6ee29f7245574666b1f6b09e7c0911d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:06.822802 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-206d8a2f-61c2-4442-ae11-b710b89b82ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:06.904622 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:06.920790 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 779/1574] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:06.934766 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0aafc-94ed-45b0-bf9d-421d054a3b39 admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:06.936555 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-b8a0aafc-94ed-45b0-bf9d-421d054a3b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:07.055095 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0aafc-94ed-45b0-bf9d-421d054a3b39 admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:07.059041 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ef5b-4731-4afe-9b35-fba01c463784 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbd529122d64e46a70f62e351b27fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:07.059827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ef5b-4731-4afe-9b35-fba01c463784 service glance] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:07.060885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ef5b-4731-4afe-9b35-fba01c463784 service glance] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:07.060885 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ef5b-4731-4afe-9b35-fba01c463784 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:07.072782 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:07.150793 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972ef5b-4731-4afe-9b35-fba01c463784 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:07.152335 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972ef5b-4731-4afe-9b35-fba01c463784 service glance] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:07.162451 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 796/1575] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:07.224889 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e749fe4-e472-4df1-9316-75d4f8a9da96 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:07.225170 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e749fe4-e472-4df1-9316-75d4f8a9da96 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:07.225437 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e749fe4-e472-4df1-9316-75d4f8a9da96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:07.255906 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-7e749fe4-e472-4df1-9316-75d4f8a9da96 None None] MFA Rules not processed for user `2b89bb10b0f248a5a46690bc68790ead`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:07.257398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-7e749fe4-e472-4df1-9316-75d4f8a9da96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:07.355498 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 780/1576] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:07.369769 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ef5b-4731-4afe-9b35-fba01c463784 service glance] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:07.378872 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ef5b-4731-4afe-9b35-fba01c463784 service glance] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:07.382723 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61103362-072b-4bdd-9e83-304167a68bc9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbd529122d64e46a70f62e351b27fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:07.383870 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61103362-072b-4bdd-9e83-304167a68bc9 service glance] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:07.383870 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61103362-072b-4bdd-9e83-304167a68bc9 service glance] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:07.384089 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61103362-072b-4bdd-9e83-304167a68bc9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:07.399314 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab45c62-b313-4079-a135-c5d9afca4b91 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:07.399601 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab45c62-b313-4079-a135-c5d9afca4b91 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:07.399878 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab45c62-b313-4079-a135-c5d9afca4b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:07.456893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61103362-072b-4bdd-9e83-304167a68bc9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:07.458395 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61103362-072b-4bdd-9e83-304167a68bc9 service glance] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:07.463552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-5ab45c62-b313-4079-a135-c5d9afca4b91 None None] MFA Rules not processed for user `7b36a416960d4106935476ef2b1682f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:07.464883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-5ab45c62-b313-4079-a135-c5d9afca4b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:07.468504 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 797/1577] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:07.539919 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 781/1578] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:07.663535 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61103362-072b-4bdd-9e83-304167a68bc9 service glance] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:07.664990 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-61103362-072b-4bdd-9e83-304167a68bc9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:07.798934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61103362-072b-4bdd-9e83-304167a68bc9 service glance] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:07.804328 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c68dd-0d17-418a-aff5-a6d392676714 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc22a3976aa47cfb4367b0a433742ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:07.805074 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c68dd-0d17-418a-aff5-a6d392676714 service swift] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:07.805445 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c68dd-0d17-418a-aff5-a6d392676714 service swift] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:07.805830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c68dd-0d17-418a-aff5-a6d392676714 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:07.815300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c68dd-0d17-418a-aff5-a6d392676714 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:07.817253 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c68dd-0d17-418a-aff5-a6d392676714 service swift] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:07.826299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 798/1579] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Oct 9 00:56:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:56:08.945370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64882-398c-40f0-852c-2d61df2a5748 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:08.946235 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64882-398c-40f0-852c-2d61df2a5748 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:08.946510 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64882-398c-40f0-852c-2d61df2a5748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:08.972063 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-b9d64882-398c-40f0-852c-2d61df2a5748 None None] MFA Rules not processed for user `7b36a416960d4106935476ef2b1682f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:08.973403 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b9d64882-398c-40f0-852c-2d61df2a5748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:08.981362 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 782/1580] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:08.996998 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c68dd-0d17-418a-aff5-a6d392676714 service swift] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:09.008316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c68dd-0d17-418a-aff5-a6d392676714 service swift] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:09.013893 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f674f-bf65-4770-b8b1-7b5dd574e8ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc22a3976aa47cfb4367b0a433742ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:09.014527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f674f-bf65-4770-b8b1-7b5dd574e8ea service swift] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:09.015118 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f674f-bf65-4770-b8b1-7b5dd574e8ea service swift] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:09.015118 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f674f-bf65-4770-b8b1-7b5dd574e8ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:09.024729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f674f-bf65-4770-b8b1-7b5dd574e8ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:09.026360 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f674f-bf65-4770-b8b1-7b5dd574e8ea service swift] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:09.035626 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 799/1581] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Oct 9 00:56:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 09 00:56:17.526590 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1d814-61ad-4e38-a3cd-c5e9eaccdc4a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:17.527252 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1d814-61ad-4e38-a3cd-c5e9eaccdc4a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:17.527657 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1d814-61ad-4e38-a3cd-c5e9eaccdc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:17.548421 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-d6d1d814-61ad-4e38-a3cd-c5e9eaccdc4a None None] MFA Rules not processed for user `67277a3f967142b3a4166e3acbd88fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:17.549721 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-d6d1d814-61ad-4e38-a3cd-c5e9eaccdc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:17.556906 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 783/1582] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:17.851936 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff8db-6288-44c9-a138-c3f8f342770f None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:17.852525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff8db-6288-44c9-a138-c3f8f342770f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:17.852525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff8db-6288-44c9-a138-c3f8f342770f None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:17.853963 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 800/1583] 10.222.0.43 () {54 vars in 961 bytes} [Sun Oct 9 00:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:17.860640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904f3fd-20ef-49c0-bafe-e0e99fe78fe3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:17.862117 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904f3fd-20ef-49c0-bafe-e0e99fe78fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:17.862440 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904f3fd-20ef-49c0-bafe-e0e99fe78fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:17.902350 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-1904f3fd-20ef-49c0-bafe-e0e99fe78fe3 None None] MFA Rules not processed for user `f960fdabbffa4813a0ea46bb82218f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:17.903544 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1904f3fd-20ef-49c0-bafe-e0e99fe78fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:17.927911 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:17.984759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 784/1584] 10.222.0.43 () {58 vars in 1058 bytes} [Sun Oct 9 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:17.989873 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad323873-5409-4fc6-b9f2-71391603b176 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:17.990150 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad323873-5409-4fc6-b9f2-71391603b176 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:17.990415 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad323873-5409-4fc6-b9f2-71391603b176 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:17.991796 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 801/1585] 10.222.0.43 () {54 vars in 912 bytes} [Sun Oct 9 00:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:17.999457 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86876856-b533-4acb-8d86-3faaf5d68160 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:17.999876 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86876856-b533-4acb-8d86-3faaf5d68160 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:18.000178 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86876856-b533-4acb-8d86-3faaf5d68160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:18.023054 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-86876856-b533-4acb-8d86-3faaf5d68160 None None] MFA Rules not processed for user `f960fdabbffa4813a0ea46bb82218f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:18.024480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-86876856-b533-4acb-8d86-3faaf5d68160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:18.040480 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 785/1586] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:18.049848 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad323873-5409-4fc6-b9f2-71391603b176 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:18.052572 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-ad323873-5409-4fc6-b9f2-71391603b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:18.063257 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=100 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:18.068958 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad323873-5409-4fc6-b9f2-71391603b176 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:18.072445 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9184a8-3057-4619-805d-b04757e78a00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbbd529122d64e46a70f62e351b27fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:18.073046 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9184a8-3057-4619-805d-b04757e78a00 service glance] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:18.073315 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9184a8-3057-4619-805d-b04757e78a00 service glance] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:18.073577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9184a8-3057-4619-805d-b04757e78a00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:18.083747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9184a8-3057-4619-805d-b04757e78a00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:18.085214 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9184a8-3057-4619-805d-b04757e78a00 service glance] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:18.098102 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 802/1587] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:18.625502 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef2f9d-2a73-4703-8b38-1fef7b803883 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:18.626030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef2f9d-2a73-4703-8b38-1fef7b803883 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:18.626030 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef2f9d-2a73-4703-8b38-1fef7b803883 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:18.627355 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 786/1588] 10.222.0.43 () {54 vars in 912 bytes} [Sun Oct 9 00:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:18.632952 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89b44d-a8cb-4312-a711-4e8b6d60afc3 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:18.633316 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89b44d-a8cb-4312-a711-4e8b6d60afc3 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:18.633659 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89b44d-a8cb-4312-a711-4e8b6d60afc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:18.679299 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-3b89b44d-a8cb-4312-a711-4e8b6d60afc3 None None] MFA Rules not processed for user `a33cbccb6a374b5f941fd4b768ff6766`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:18.680666 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3b89b44d-a8cb-4312-a711-4e8b6d60afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:18.742751 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 803/1589] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:18.754375 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef2f9d-2a73-4703-8b38-1fef7b803883 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:18.764795 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef2f9d-2a73-4703-8b38-1fef7b803883 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:18.768147 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf9fe4-fb11-4544-8464-ce4ed368513d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:18.768733 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf9fe4-fb11-4544-8464-ce4ed368513d service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:18.769002 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf9fe4-fb11-4544-8464-ce4ed368513d service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:18.769264 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf9fe4-fb11-4544-8464-ce4ed368513d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:18.776413 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf9fe4-fb11-4544-8464-ce4ed368513d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:18.777887 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf9fe4-fb11-4544-8464-ce4ed368513d service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:18.785420 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 787/1590] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:19.209655 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87df1e-b2b5-4874-be10-2f4b9f28c74c None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:19.210216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87df1e-b2b5-4874-be10-2f4b9f28c74c None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:19.210216 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87df1e-b2b5-4874-be10-2f4b9f28c74c None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:19.211845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 804/1591] 10.222.0.43 () {54 vars in 961 bytes} [Sun Oct 9 00:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:19.218119 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca39b9-a579-45e9-8927-7ad5f2a55b4a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:19.218464 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca39b9-a579-45e9-8927-7ad5f2a55b4a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:19.218739 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca39b9-a579-45e9-8927-7ad5f2a55b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:19.234035 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87df1e-b2b5-4874-be10-2f4b9f28c74c None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:19.239569 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-54ca39b9-a579-45e9-8927-7ad5f2a55b4a None None] MFA Rules not processed for user `f960fdabbffa4813a0ea46bb82218f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:19.240901 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-54ca39b9-a579-45e9-8927-7ad5f2a55b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:19.251272 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 788/1592] 10.222.0.43 () {58 vars in 1058 bytes} [Sun Oct 9 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:19.257338 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca87fd4-27c9-49be-b95c-6c34637c5111 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:19.257870 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca87fd4-27c9-49be-b95c-6c34637c5111 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:19.258144 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca87fd4-27c9-49be-b95c-6c34637c5111 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:19.264330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 789/1593] 10.222.0.43 () {54 vars in 912 bytes} [Sun Oct 9 00:56:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:56:19.265716 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cdbe4-9658-4329-84c7-eab18b183016 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:19.266006 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cdbe4-9658-4329-84c7-eab18b183016 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:19.266284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cdbe4-9658-4329-84c7-eab18b183016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:19.285769 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9e8cdbe4-9658-4329-84c7-eab18b183016 None None] MFA Rules not processed for user `f960fdabbffa4813a0ea46bb82218f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:19.286979 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9e8cdbe4-9658-4329-84c7-eab18b183016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:19.297043 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 790/1594] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:19.308238 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cdbe4-9658-4329-84c7-eab18b183016 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:19.308743 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87df1e-b2b5-4874-be10-2f4b9f28c74c None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:19.313753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f210727-305f-43e7-965f-8971ebb1c7b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536ebcc364834a75beefab0f2b0cc196', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:19.314389 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f210727-305f-43e7-965f-8971ebb1c7b4 service placement] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:19.314662 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f210727-305f-43e7-965f-8971ebb1c7b4 service placement] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:19.314937 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f210727-305f-43e7-965f-8971ebb1c7b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:19.316705 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-8f210727-305f-43e7-965f-8971ebb1c7b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:19.317801 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cdbe4-9658-4329-84c7-eab18b183016 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:19.321323 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318250e6-ac9b-4627-9c79-af4c7016abef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:19.321914 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318250e6-ac9b-4627-9c79-af4c7016abef service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:19.322189 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318250e6-ac9b-4627-9c79-af4c7016abef service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:19.322460 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318250e6-ac9b-4627-9c79-af4c7016abef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:19.328805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f210727-305f-43e7-965f-8971ebb1c7b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:19.330483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f210727-305f-43e7-965f-8971ebb1c7b4 service placement] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:19.333206 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318250e6-ac9b-4627-9c79-af4c7016abef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:19.334675 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318250e6-ac9b-4627-9c79-af4c7016abef service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:19.341649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 805/1595] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:56:19.345699 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 791/1596] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:56:21.347497 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bdf97-43a3-4fd5-8ee3-3d1a07cb1c1f None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:21.347999 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bdf97-43a3-4fd5-8ee3-3d1a07cb1c1f None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:21.348138 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bdf97-43a3-4fd5-8ee3-3d1a07cb1c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:21.369312 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-3d5bdf97-43a3-4fd5-8ee3-3d1a07cb1c1f None None] MFA Rules not processed for user `7b36a416960d4106935476ef2b1682f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:21.370443 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-3d5bdf97-43a3-4fd5-8ee3-3d1a07cb1c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:21.378888 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 806/1597] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:21.392126 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318250e6-ac9b-4627-9c79-af4c7016abef service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:21.403433 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318250e6-ac9b-4627-9c79-af4c7016abef service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:21.408508 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cfa88-d093-45d7-b731-a4620c4327b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc22a3976aa47cfb4367b0a433742ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:21.409115 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cfa88-d093-45d7-b731-a4620c4327b3 service swift] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:21.409392 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cfa88-d093-45d7-b731-a4620c4327b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:21.409662 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cfa88-d093-45d7-b731-a4620c4327b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:21.417899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cfa88-d093-45d7-b731-a4620c4327b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:21.419643 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cfa88-d093-45d7-b731-a4620c4327b3 service swift] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:21.428078 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 792/1598] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Oct 9 00:56:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:56:29.799819 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555465-f759-4b90-8fbd-b866b116e9ae None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:29.800378 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555465-f759-4b90-8fbd-b866b116e9ae None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:29.800483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555465-f759-4b90-8fbd-b866b116e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:29.822971 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-76555465-f759-4b90-8fbd-b866b116e9ae None None] MFA Rules not processed for user `a33cbccb6a374b5f941fd4b768ff6766`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:29.824410 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-76555465-f759-4b90-8fbd-b866b116e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:29.832157 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 807/1599] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Oct 9 00:56:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:29.845192 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cfa88-d093-45d7-b731-a4620c4327b3 service swift] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:29.855115 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cfa88-d093-45d7-b731-a4620c4327b3 service swift] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:29.859886 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e200c76-2020-494a-af78-94de95aa91bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:29.860574 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e200c76-2020-494a-af78-94de95aa91bb service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:29.860883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e200c76-2020-494a-af78-94de95aa91bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:29.861180 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e200c76-2020-494a-af78-94de95aa91bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:29.870177 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e200c76-2020-494a-af78-94de95aa91bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:29.871702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e200c76-2020-494a-af78-94de95aa91bb service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:29.880718 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 793/1600] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:30.683608 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ee84-eb22-4b5b-8a6e-63e26d7f78a1 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:30.683961 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ee84-eb22-4b5b-8a6e-63e26d7f78a1 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:30.684262 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884ee84-eb22-4b5b-8a6e-63e26d7f78a1 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:30.685595 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 808/1601] 10.222.0.43 () {54 vars in 921 bytes} [Sun Oct 9 00:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:30.720848 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f684b-25c0-4ec4-a33e-001f80f6aa4a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:30.721206 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f684b-25c0-4ec4-a33e-001f80f6aa4a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:30.721531 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f684b-25c0-4ec4-a33e-001f80f6aa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:30.741977 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-526f684b-25c0-4ec4-a33e-001f80f6aa4a None None] MFA Rules not processed for user `f960fdabbffa4813a0ea46bb82218f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:30.743196 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-526f684b-25c0-4ec4-a33e-001f80f6aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:30.753628 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 794/1602] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Oct 9 00:56:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:30.774918 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884ee84-eb22-4b5b-8a6e-63e26d7f78a1 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:30.792552 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884ee84-eb22-4b5b-8a6e-63e26d7f78a1 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:30.798834 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8181e98-ed73-41ef-a03c-4b7a8a664719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:30.799613 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8181e98-ed73-41ef-a03c-4b7a8a664719 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:30.799956 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8181e98-ed73-41ef-a03c-4b7a8a664719 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:30.800601 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8181e98-ed73-41ef-a03c-4b7a8a664719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:30.826753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8181e98-ed73-41ef-a03c-4b7a8a664719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:30.828483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8181e98-ed73-41ef-a03c-4b7a8a664719 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:30.844993 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 809/1603] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:36.032154 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9436e0-e33c-4c99-bd7f-6d66723dce43 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.033281 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9436e0-e33c-4c99-bd7f-6d66723dce43 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.033281 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9436e0-e33c-4c99-bd7f-6d66723dce43 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.034451 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 795/1604] 10.222.0.43 () {54 vars in 921 bytes} [Sun Oct 9 00:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:36.043714 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16088a9-12bb-43e3-bc61-31efab19192b None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.044271 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16088a9-12bb-43e3-bc61-31efab19192b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.044362 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16088a9-12bb-43e3-bc61-31efab19192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.069849 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-a16088a9-12bb-43e3-bc61-31efab19192b None None] MFA Rules not processed for user `f960fdabbffa4813a0ea46bb82218f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:36.071173 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-a16088a9-12bb-43e3-bc61-31efab19192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:36.081740 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 810/1605] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Oct 9 00:56:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:36.097899 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9436e0-e33c-4c99-bd7f-6d66723dce43 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:36.127757 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9436e0-e33c-4c99-bd7f-6d66723dce43 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:36.133370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853498ba-b787-4a8b-84d7-7ec10def1c2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:36.134038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853498ba-b787-4a8b-84d7-7ec10def1c2a service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.134373 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853498ba-b787-4a8b-84d7-7ec10def1c2a service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.134702 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853498ba-b787-4a8b-84d7-7ec10def1c2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.143828 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853498ba-b787-4a8b-84d7-7ec10def1c2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:36.145528 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853498ba-b787-4a8b-84d7-7ec10def1c2a service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:36.156581 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 796/1606] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:46.065014 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=80 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:46.152869 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=61 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:56.103296 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16088a9-12bb-43e3-bc61-31efab19192b None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:56.113671 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16088a9-12bb-43e3-bc61-31efab19192b None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:56.118387 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783afdc0-e34e-41d1-9447-ae9bc768c594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:56.119018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783afdc0-e34e-41d1-9447-ae9bc768c594 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:56.119293 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783afdc0-e34e-41d1-9447-ae9bc768c594 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:56.119547 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783afdc0-e34e-41d1-9447-ae9bc768c594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:56.129323 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783afdc0-e34e-41d1-9447-ae9bc768c594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:56.130784 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783afdc0-e34e-41d1-9447-ae9bc768c594 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:56.140289 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 811/1607] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:58.172013 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a4e69-c153-42b5-abdc-30fc991c6c90 None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:58.172583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a4e69-c153-42b5-abdc-30fc991c6c90 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:58.172933 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a4e69-c153-42b5-abdc-30fc991c6c90 None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:58.174767 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 797/1608] 10.222.0.43 () {54 vars in 921 bytes} [Sun Oct 9 00:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:58.180920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f5996-f631-464f-af4a-96a165415b65 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:58.181426 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f5996-f631-464f-af4a-96a165415b65 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:58.181540 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f5996-f631-464f-af4a-96a165415b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:58.203915 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-4a4f5996-f631-464f-af4a-96a165415b65 None None] MFA Rules not processed for user `f960fdabbffa4813a0ea46bb82218f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:58.205369 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-4a4f5996-f631-464f-af4a-96a165415b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:58.214971 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 812/1609] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Oct 9 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:58.236533 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a4e69-c153-42b5-abdc-30fc991c6c90 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:58.255925 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a4e69-c153-42b5-abdc-30fc991c6c90 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:58.262165 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618e11a-93c1-4e4e-aba5-921eba6c6527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:58.262897 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e11a-93c1-4e4e-aba5-921eba6c6527 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:58.263266 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e11a-93c1-4e4e-aba5-921eba6c6527 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:58.263632 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e11a-93c1-4e4e-aba5-921eba6c6527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:58.274523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618e11a-93c1-4e4e-aba5-921eba6c6527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:58.276741 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618e11a-93c1-4e4e-aba5-921eba6c6527 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:58.292552 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 798/1610] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:00.831875 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4065-a64f-458b-a801-13d210368199 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:00.832479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4065-a64f-458b-a801-13d210368199 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:00.832479 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4065-a64f-458b-a801-13d210368199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:00.852760 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-e64c4065-a64f-458b-a801-13d210368199 None None] MFA Rules not processed for user `6c06cf5d26e4459a9cf7a023beb2e3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:00.853996 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e64c4065-a64f-458b-a801-13d210368199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:00.862287 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 813/1611] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:57:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:08.285876 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=6 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:10.846830 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=12 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:41.385680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc15e9-f5df-4b21-9e3f-699ae72a4c58 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.386285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc15e9-f5df-4b21-9e3f-699ae72a4c58 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.386285 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc15e9-f5df-4b21-9e3f-699ae72a4c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.409188 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-8acc15e9-f5df-4b21-9e3f-699ae72a4c58 None None] MFA Rules not processed for user `6c06cf5d26e4459a9cf7a023beb2e3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:41.411182 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-8acc15e9-f5df-4b21-9e3f-699ae72a4c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:41.423883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 799/1612] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:57:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:41.741759 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717057-8b96-4a88-b2a9-5c0462d4a3c0 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.742328 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717057-8b96-4a88-b2a9-5c0462d4a3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.742328 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717057-8b96-4a88-b2a9-5c0462d4a3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.763845 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-c0717057-8b96-4a88-b2a9-5c0462d4a3c0 None None] MFA Rules not processed for user `a33cbccb6a374b5f941fd4b768ff6766`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:41.765083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-c0717057-8b96-4a88-b2a9-5c0462d4a3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:41.773002 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 814/1613] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Oct 9 00:57:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:41.785158 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc15e9-f5df-4b21-9e3f-699ae72a4c58 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:41.796318 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc15e9-f5df-4b21-9e3f-699ae72a4c58 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:41.801344 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74651815-9964-4240-85e3-1a7c729d9166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:41.801974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74651815-9964-4240-85e3-1a7c729d9166 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.802246 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74651815-9964-4240-85e3-1a7c729d9166 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.802497 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74651815-9964-4240-85e3-1a7c729d9166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.813368 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74651815-9964-4240-85e3-1a7c729d9166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:41.815609 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74651815-9964-4240-85e3-1a7c729d9166 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:41.825735 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 800/1614] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:51.757323 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=3 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:51.822124 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=9 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:58.753014 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9cb66-80ad-4a71-b107-405d9e722ca7 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:58.753527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9cb66-80ad-4a71-b107-405d9e722ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:58.753527 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9cb66-80ad-4a71-b107-405d9e722ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:58.776030 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-61b9cb66-80ad-4a71-b107-405d9e722ca7 None None] MFA Rules not processed for user `7b36a416960d4106935476ef2b1682f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:58.777347 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-61b9cb66-80ad-4a71-b107-405d9e722ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:58.785242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 815/1615] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Oct 9 00:57:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:58.826438 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74651815-9964-4240-85e3-1a7c729d9166 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:58.839251 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74651815-9964-4240-85e3-1a7c729d9166 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:58.845284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7960a3-1c34-4b47-af32-597dfa37e07e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc22a3976aa47cfb4367b0a433742ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:58.845912 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7960a3-1c34-4b47-af32-597dfa37e07e service swift] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:58.846186 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7960a3-1c34-4b47-af32-597dfa37e07e service swift] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:58.846452 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7960a3-1c34-4b47-af32-597dfa37e07e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:58.855398 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7960a3-1c34-4b47-af32-597dfa37e07e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:58.857033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7960a3-1c34-4b47-af32-597dfa37e07e service swift] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:58.865974 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 801/1616] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Oct 9 00:57:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:58:02.268069 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8aee-a60f-4af1-b544-9a0ff85af686 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:02.268615 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8aee-a60f-4af1-b544-9a0ff85af686 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:02.268615 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec8aee-a60f-4af1-b544-9a0ff85af686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:02.290172 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-95ec8aee-a60f-4af1-b544-9a0ff85af686 None None] MFA Rules not processed for user `6c06cf5d26e4459a9cf7a023beb2e3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:02.291496 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-95ec8aee-a60f-4af1-b544-9a0ff85af686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:02.299736 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 816/1617] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:58:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:08.861961 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=6 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:58:12.283702 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=6 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:58:30.978816 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7582ad-b0ec-4a6f-9aea-fb5ae07e4d3a None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:30.979370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7582ad-b0ec-4a6f-9aea-fb5ae07e4d3a None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:30.979370 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7582ad-b0ec-4a6f-9aea-fb5ae07e4d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:30.999761 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-cf7582ad-b0ec-4a6f-9aea-fb5ae07e4d3a None None] MFA Rules not processed for user `7b36a416960d4106935476ef2b1682f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:31.001014 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-cf7582ad-b0ec-4a6f-9aea-fb5ae07e4d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:31.008729 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 802/1618] 10.222.0.43 () {58 vars in 967 bytes} [Sun Oct 9 00:58:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:31.023951 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec8aee-a60f-4af1-b544-9a0ff85af686 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:31.037496 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec8aee-a60f-4af1-b544-9a0ff85af686 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:31.043018 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ee2c1-82be-4a7e-94a5-4febf706d817 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc22a3976aa47cfb4367b0a433742ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:31.043645 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ee2c1-82be-4a7e-94a5-4febf706d817 service swift] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:31.043916 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ee2c1-82be-4a7e-94a5-4febf706d817 service swift] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:31.044190 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ee2c1-82be-4a7e-94a5-4febf706d817 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:31.053366 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ee2c1-82be-4a7e-94a5-4febf706d817 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:31.054966 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ee2c1-82be-4a7e-94a5-4febf706d817 service swift] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:31.064601 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 817/1619] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Oct 9 00:58:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:58:40.994951 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:58:41.061001 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=6 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:58:46.755988 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1338c8-cec0-42d6-8f1d-c18dcfb0e018 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:46.756579 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1338c8-cec0-42d6-8f1d-c18dcfb0e018 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:46.756579 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1338c8-cec0-42d6-8f1d-c18dcfb0e018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:46.779384 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-9a1338c8-cec0-42d6-8f1d-c18dcfb0e018 None None] MFA Rules not processed for user `6c06cf5d26e4459a9cf7a023beb2e3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:46.780697 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-9a1338c8-cec0-42d6-8f1d-c18dcfb0e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:46.788989 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 803/1620] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 00:58:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:56.771556 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:59:03.273097 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ee2c1-82be-4a7e-94a5-4febf706d817 service swift] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:59:03.282137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ee2c1-82be-4a7e-94a5-4febf706d817 service swift] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:59:03.285965 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc680e5-6f1e-4268-a562-b69929ac8745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:59:03.286553 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc680e5-6f1e-4268-a562-b69929ac8745 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:03.286805 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc680e5-6f1e-4268-a562-b69929ac8745 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:03.287066 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc680e5-6f1e-4268-a562-b69929ac8745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:03.296361 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc680e5-6f1e-4268-a562-b69929ac8745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:59:03.297753 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc680e5-6f1e-4268-a562-b69929ac8745 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:59:03.306987 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 818/1621] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 00:59:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:59:13.302861 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=6 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:00:08.263487 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1ebee-c86d-4d3e-8870-5b4e669677de None None] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:08.263950 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1ebee-c86d-4d3e-8870-5b4e669677de None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:08.264241 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1ebee-c86d-4d3e-8870-5b4e669677de None None] PATH_INFO: `/` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:08.265667 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 804/1622] 10.222.0.43 () {54 vars in 961 bytes} [Sun Oct 9 01:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 01:00:08.271044 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d013177-ba5a-4303-b0f3-3c633e1c0970 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:08.271595 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d013177-ba5a-4303-b0f3-3c633e1c0970 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:08.271950 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d013177-ba5a-4303-b0f3-3c633e1c0970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:08.293427 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-5d013177-ba5a-4303-b0f3-3c633e1c0970 None None] MFA Rules not processed for user `536ebcc364834a75beefab0f2b0cc196`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:08.294559 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-5d013177-ba5a-4303-b0f3-3c633e1c0970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:08.303686 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 819/1623] 10.222.0.43 () {58 vars in 1058 bytes} [Sun Oct 9 01:00:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:08.311800 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1ebee-c86d-4d3e-8870-5b4e669677de None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:08.326463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1ebee-c86d-4d3e-8870-5b4e669677de None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:08.331868 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6db7-8905-4c39-b4b5-3cbb10b214f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536ebcc364834a75beefab0f2b0cc196', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:08.332500 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6db7-8905-4c39-b4b5-3cbb10b214f8 service placement] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:08.332779 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6db7-8905-4c39-b4b5-3cbb10b214f8 service placement] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:08.333049 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6db7-8905-4c39-b4b5-3cbb10b214f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:08.342433 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc6db7-8905-4c39-b4b5-3cbb10b214f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:08.344060 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc6db7-8905-4c39-b4b5-3cbb10b214f8 service placement] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:08.355312 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 805/1624] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:00:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:00:09.452542 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b474b-a4ab-48be-a120-78f383677a16 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:09.453303 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b474b-a4ab-48be-a120-78f383677a16 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:09.453465 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b474b-a4ab-48be-a120-78f383677a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:09.472526 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-e83b474b-a4ab-48be-a120-78f383677a16 None None] MFA Rules not processed for user `7b36a416960d4106935476ef2b1682f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:09.473827 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e83b474b-a4ab-48be-a120-78f383677a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:09.481046 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 820/1625] 10.222.0.43 () {58 vars in 967 bytes} [Sun Oct 9 01:00:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:09.530243 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6db7-8905-4c39-b4b5-3cbb10b214f8 service placement] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:09.541409 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6db7-8905-4c39-b4b5-3cbb10b214f8 service placement] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:09.547412 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30595e3d-1262-4b8e-b821-0596a7bf679f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc22a3976aa47cfb4367b0a433742ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:09.548018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30595e3d-1262-4b8e-b821-0596a7bf679f service swift] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:09.548322 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30595e3d-1262-4b8e-b821-0596a7bf679f service swift] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:09.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30595e3d-1262-4b8e-b821-0596a7bf679f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:09.560860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30595e3d-1262-4b8e-b821-0596a7bf679f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:09.563305 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30595e3d-1262-4b8e-b821-0596a7bf679f service swift] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:09.573518 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 806/1626] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Oct 9 01:00:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:00:10.081522 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed8a0-26d0-45f0-87a6-9c102153d1cf None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:10.081816 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed8a0-26d0-45f0-87a6-9c102153d1cf None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:10.082073 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed8a0-26d0-45f0-87a6-9c102153d1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:10.101156 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-02eed8a0-26d0-45f0-87a6-9c102153d1cf None None] MFA Rules not processed for user `7b36a416960d4106935476ef2b1682f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:10.102339 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-02eed8a0-26d0-45f0-87a6-9c102153d1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:10.109784 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 821/1627] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Oct 9 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:10.127825 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30595e3d-1262-4b8e-b821-0596a7bf679f service swift] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:10.140000 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30595e3d-1262-4b8e-b821-0596a7bf679f service swift] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:10.145324 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fe589-d45f-4be5-b767-3766d8bca8f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc22a3976aa47cfb4367b0a433742ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:10.145918 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fe589-d45f-4be5-b767-3766d8bca8f4 service swift] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:10.146194 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fe589-d45f-4be5-b767-3766d8bca8f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:10.146513 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fe589-d45f-4be5-b767-3766d8bca8f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:10.154997 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fe589-d45f-4be5-b767-3766d8bca8f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:10.156622 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fe589-d45f-4be5-b767-3766d8bca8f4 service swift] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:10.164770 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 807/1628] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Oct 9 01:00:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:00:18.657266 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35511400-0294-4cb8-b02a-16384e3acb99 None None] REQUEST_METHOD: `POST` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:18.657752 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35511400-0294-4cb8-b02a-16384e3acb99 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:18.657909 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35511400-0294-4cb8-b02a-16384e3acb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:18.677927 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.auth.core [None req-35511400-0294-4cb8-b02a-16384e3acb99 None None] MFA Rules not processed for user `67277a3f967142b3a4166e3acbd88fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:18.679185 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-35511400-0294-4cb8-b02a-16384e3acb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:18.687141 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 822/1629] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:20.161680 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=18 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:00:20.677890 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e3846-087f-403e-93d3-e22f398f6255 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:20.678360 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e3846-087f-403e-93d3-e22f398f6255 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:20.678798 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e3846-087f-403e-93d3-e22f398f6255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:20.699971 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-538e3846-087f-403e-93d3-e22f398f6255 None None] MFA Rules not processed for user `7b36a416960d4106935476ef2b1682f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:20.701257 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-538e3846-087f-403e-93d3-e22f398f6255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:20.709130 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 808/1630] 10.222.0.43 () {58 vars in 1009 bytes} [Sun Oct 9 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:20.721752 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35511400-0294-4cb8-b02a-16384e3acb99 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:20.734578 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35511400-0294-4cb8-b02a-16384e3acb99 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:20.739976 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c5521-0d2b-4615-9692-e7ccb7cb38fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc22a3976aa47cfb4367b0a433742ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:20.740584 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c5521-0d2b-4615-9692-e7ccb7cb38fe service swift] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:20.740912 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c5521-0d2b-4615-9692-e7ccb7cb38fe service swift] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:20.741213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c5521-0d2b-4615-9692-e7ccb7cb38fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:20.749663 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c5521-0d2b-4615-9692-e7ccb7cb38fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:20.751279 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c5521-0d2b-4615-9692-e7ccb7cb38fe service swift] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:20.759890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 823/1631] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Oct 9 01:00:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:00:30.694895 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:00:30.756729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=18 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:01.995559 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a96eda-18bc-4387-859b-ff977621a0ff None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:01.996147 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a96eda-18bc-4387-859b-ff977621a0ff None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:01.996147 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a96eda-18bc-4387-859b-ff977621a0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:02.019384 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-99a96eda-18bc-4387-859b-ff977621a0ff None None] MFA Rules not processed for user `6c06cf5d26e4459a9cf7a023beb2e3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:02.020600 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-99a96eda-18bc-4387-859b-ff977621a0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:02.027703 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 809/1632] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 01:01:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:01:07.202466 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c5521-0d2b-4615-9692-e7ccb7cb38fe service swift] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:07.215377 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c5521-0d2b-4615-9692-e7ccb7cb38fe service swift] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:07.221482 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac12bf6-c4af-45b8-acb3-cf87c232828e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:07.222155 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac12bf6-c4af-45b8-acb3-cf87c232828e service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:07.222492 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac12bf6-c4af-45b8-acb3-cf87c232828e service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:07.222824 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac12bf6-c4af-45b8-acb3-cf87c232828e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:07.231225 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac12bf6-c4af-45b8-acb3-cf87c232828e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:07.232854 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac12bf6-c4af-45b8-acb3-cf87c232828e service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:07.242286 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 824/1633] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:12.014580 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=3 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:13.662532 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a96eda-18bc-4387-859b-ff977621a0ff None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:13.677348 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a96eda-18bc-4387-859b-ff977621a0ff None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:13.685018 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a4564-253c-4356-aeb3-ebd6a77ad4d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:13.685798 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a4564-253c-4356-aeb3-ebd6a77ad4d3 service nova] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:13.686064 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a4564-253c-4356-aeb3-ebd6a77ad4d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:13.686330 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a4564-253c-4356-aeb3-ebd6a77ad4d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:13.694365 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a4564-253c-4356-aeb3-ebd6a77ad4d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:13.695945 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a4564-253c-4356-aeb3-ebd6a77ad4d3 service nova] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:13.704843 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 810/1634] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:17.238119 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=6 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:18.004570 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac12bf6-c4af-45b8-acb3-cf87c232828e service nova] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:18.014429 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac12bf6-c4af-45b8-acb3-cf87c232828e service nova] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:18.018346 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686fbdb-831f-42de-814b-ebdfb1cba48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:18.018938 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686fbdb-831f-42de-814b-ebdfb1cba48d service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:18.019211 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686fbdb-831f-42de-814b-ebdfb1cba48d service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:18.019481 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686fbdb-831f-42de-814b-ebdfb1cba48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:18.030258 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686fbdb-831f-42de-814b-ebdfb1cba48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:18.031729 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686fbdb-831f-42de-814b-ebdfb1cba48d service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:18.042829 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 825/1635] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:19.445725 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a4564-253c-4356-aeb3-ebd6a77ad4d3 service nova] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:19.459369 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a4564-253c-4356-aeb3-ebd6a77ad4d3 service nova] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:19.463859 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694b184-6718-4b85-b5ad-731bfc162149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:19.464496 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b184-6718-4b85-b5ad-731bfc162149 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:19.464771 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b184-6718-4b85-b5ad-731bfc162149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:19.465038 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b184-6718-4b85-b5ad-731bfc162149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:19.481581 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694b184-6718-4b85-b5ad-731bfc162149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:19.483799 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694b184-6718-4b85-b5ad-731bfc162149 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:19.497438 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 811/1636] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:28.038890 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=6 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:29.492425 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=12 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:04.840103 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686fbdb-831f-42de-814b-ebdfb1cba48d service neutron] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:04.856404 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686fbdb-831f-42de-814b-ebdfb1cba48d service neutron] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:04.864951 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c692d1-5cf0-4197-9476-8a34b0edd1f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:04.865593 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c692d1-5cf0-4197-9476-8a34b0edd1f3 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:04.865868 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c692d1-5cf0-4197-9476-8a34b0edd1f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:04.866137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c692d1-5cf0-4197-9476-8a34b0edd1f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:04.875748 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c692d1-5cf0-4197-9476-8a34b0edd1f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:04.877377 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c692d1-5cf0-4197-9476-8a34b0edd1f3 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:04.899200 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 826/1637] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:04.987697 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694b184-6718-4b85-b5ad-731bfc162149 service neutron] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:04.999440 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694b184-6718-4b85-b5ad-731bfc162149 service neutron] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:05.004114 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8a585-35f6-49e7-9b4a-27dd329309f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:05.004838 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8a585-35f6-49e7-9b4a-27dd329309f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:05.008376 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8a585-35f6-49e7-9b4a-27dd329309f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:05.008624 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8a585-35f6-49e7-9b4a-27dd329309f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:05.020423 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8a585-35f6-49e7-9b4a-27dd329309f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:05.022158 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8a585-35f6-49e7-9b4a-27dd329309f0 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:05.032699 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 812/1638] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:02:10.977234 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c692d1-5cf0-4197-9476-8a34b0edd1f3 service nova] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:10.989071 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c692d1-5cf0-4197-9476-8a34b0edd1f3 service nova] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:10.994865 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b87886-3f5d-4ed1-9ffc-c6611ea12a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:10.995472 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b87886-3f5d-4ed1-9ffc-c6611ea12a60 service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:10.995742 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b87886-3f5d-4ed1-9ffc-c6611ea12a60 service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:10.996007 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b87886-3f5d-4ed1-9ffc-c6611ea12a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:11.005532 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b87886-3f5d-4ed1-9ffc-c6611ea12a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:11.007242 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b87886-3f5d-4ed1-9ffc-c6611ea12a60 service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:11.017624 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 827/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:12.100329 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9faf-7057-4289-8c44-86c9a9a410dc None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:12.100807 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9faf-7057-4289-8c44-86c9a9a410dc None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:12.100894 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9faf-7057-4289-8c44-86c9a9a410dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:12.121549 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-f24a9faf-7057-4289-8c44-86c9a9a410dc None None] MFA Rules not processed for user `7b36a416960d4106935476ef2b1682f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:12.122748 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-f24a9faf-7057-4289-8c44-86c9a9a410dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:12.130576 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 813/1640] 10.222.0.43 () {58 vars in 967 bytes} [Sun Oct 9 01:02:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:12.173195 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b87886-3f5d-4ed1-9ffc-c6611ea12a60 service nova] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:12.185363 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b87886-3f5d-4ed1-9ffc-c6611ea12a60 service nova] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:12.191137 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572a8d-5564-42c2-a350-6d414db69f25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc22a3976aa47cfb4367b0a433742ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:12.191790 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572a8d-5564-42c2-a350-6d414db69f25 service swift] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:12.192101 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572a8d-5564-42c2-a350-6d414db69f25 service swift] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:12.192391 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572a8d-5564-42c2-a350-6d414db69f25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:12.200487 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab572a8d-5564-42c2-a350-6d414db69f25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:12.202072 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab572a8d-5564-42c2-a350-6d414db69f25 service swift] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:12.210134 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 828/1641] 10.222.0.43 () {60 vars in 1384 bytes} [Sun Oct 9 01:02:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:02:12.594726 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a9faf-7057-4289-8c44-86c9a9a410dc None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:12.606081 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a9faf-7057-4289-8c44-86c9a9a410dc None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:12.610797 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339acef-7e35-48e2-a27c-b56e59c29b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:12.611394 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339acef-7e35-48e2-a27c-b56e59c29b79 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:12.611666 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339acef-7e35-48e2-a27c-b56e59c29b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:12.611927 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339acef-7e35-48e2-a27c-b56e59c29b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:12.686583 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339acef-7e35-48e2-a27c-b56e59c29b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:12.688065 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339acef-7e35-48e2-a27c-b56e59c29b79 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:12.700852 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 814/1642] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:16.149747 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8beb3-513b-4535-9f36-9682a25cec62 None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:16.150263 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8beb3-513b-4535-9f36-9682a25cec62 None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:16.150371 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8beb3-513b-4535-9f36-9682a25cec62 None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:16.151637 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 829/1643] 10.222.0.43 () {54 vars in 921 bytes} [Sun Oct 9 01:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 01:02:16.167489 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683af7-4e17-48f9-9f69-6a575d24af85 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:16.168033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683af7-4e17-48f9-9f69-6a575d24af85 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:16.168033 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683af7-4e17-48f9-9f69-6a575d24af85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:16.189897 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-68683af7-4e17-48f9-9f69-6a575d24af85 None None] MFA Rules not processed for user `536ebcc364834a75beefab0f2b0cc196`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:16.191057 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-68683af7-4e17-48f9-9f69-6a575d24af85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:16.200316 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 815/1644] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Oct 9 01:02:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:16.214806 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8beb3-513b-4535-9f36-9682a25cec62 None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:16.230368 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8beb3-513b-4535-9f36-9682a25cec62 None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:16.237290 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62620ece-5157-413c-afa1-26c21b8d9920 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536ebcc364834a75beefab0f2b0cc196', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:16.237887 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62620ece-5157-413c-afa1-26c21b8d9920 service placement] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:16.238409 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62620ece-5157-413c-afa1-26c21b8d9920 service placement] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:16.238713 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62620ece-5157-413c-afa1-26c21b8d9920 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:16.250311 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62620ece-5157-413c-afa1-26c21b8d9920 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:16.251898 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62620ece-5157-413c-afa1-26c21b8d9920 service placement] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:16.262970 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 830/1645] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:19.368195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68683af7-4e17-48f9-9f69-6a575d24af85 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:19.386031 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68683af7-4e17-48f9-9f69-6a575d24af85 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:19.390521 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:19.391078 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:19.391354 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:19.391679 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] PATH_INFO: `/v3/users/67277a3f967142b3a4166e3acbd88fc7` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:19.392850 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=67277a3f967142b3a4166e3acbd88fc7)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:19.395152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:19.445428 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67277a3f967142b3a4166e3acbd88fc7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.446090 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67277a3f967142b3a4166e3acbd88fc7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.459136 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67277a3f967142b3a4166e3acbd88fc7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.466548 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67277a3f967142b3a4166e3acbd88fc7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.467208 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67277a3f967142b3a4166e3acbd88fc7'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.480493 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 816/1646] 10.222.0.43 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:19 2022] DELETE /identity/v3/users/67277a3f967142b3a4166e3acbd88fc7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:19.682073 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62620ece-5157-413c-afa1-26c21b8d9920 service placement] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:19.693337 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62620ece-5157-413c-afa1-26c21b8d9920 service placement] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:19.751962 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:19.752630 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:19.752906 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:19.753175 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] PATH_INFO: `/v3/projects/9b952be6d0784abdb2e25b8389a401aa` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:19.754319 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b952be6d0784abdb2e25b8389a401aa)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:19.756273 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:19.803927 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b952be6d0784abdb2e25b8389a401aa', 'request_id': 'req-e429487c-6b84-40a5-ab85-11278a05de6c'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.811023 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b952be6d0784abdb2e25b8389a401aa', 'request_id': 'req-e429487c-6b84-40a5-ab85-11278a05de6c'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.819249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b952be6d0784abdb2e25b8389a401aa', 'request_id': 'req-e429487c-6b84-40a5-ab85-11278a05de6c'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.829631 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] The token cache is being invalidate because project 9b952be6d0784abdb2e25b8389a401aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:19.829920 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.830628 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.832556 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 831/1647] 10.222.0.43 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:19 2022] DELETE /identity/v3/projects/9b952be6d0784abdb2e25b8389a401aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:19.836986 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:19.838515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:19.854973 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47290bf-6ea4-4028-92f2-4edd97655a1e admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:19.897341 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:19.919064 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c7675-630a-4ec2-8cc5-91057d542653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:19.919759 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7675-630a-4ec2-8cc5-91057d542653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:19.920032 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7675-630a-4ec2-8cc5-91057d542653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:19.920335 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7675-630a-4ec2-8cc5-91057d542653 admin admin] PATH_INFO: `/v3/users/6ee29f7245574666b1f6b09e7c0911d9` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:19.921515 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c7675-630a-4ec2-8cc5-91057d542653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee29f7245574666b1f6b09e7c0911d9)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:19.923463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c7675-630a-4ec2-8cc5-91057d542653 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:19.970880 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-506c7675-630a-4ec2-8cc5-91057d542653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee29f7245574666b1f6b09e7c0911d9'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.971523 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-506c7675-630a-4ec2-8cc5-91057d542653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee29f7245574666b1f6b09e7c0911d9'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.983751 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-506c7675-630a-4ec2-8cc5-91057d542653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee29f7245574666b1f6b09e7c0911d9'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.992195 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-506c7675-630a-4ec2-8cc5-91057d542653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee29f7245574666b1f6b09e7c0911d9'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:19.992912 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-506c7675-630a-4ec2-8cc5-91057d542653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee29f7245574666b1f6b09e7c0911d9'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:20.005864 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 817/1648] 10.222.0.43 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:19 2022] DELETE /identity/v3/users/6ee29f7245574666b1f6b09e7c0911d9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:20.182649 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:20.184118 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:20.197088 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429487c-6b84-40a5-ab85-11278a05de6c admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:20.233261 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:20.260300 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:20.260992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:20.261249 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:20.261516 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] PATH_INFO: `/v3/projects/4276506b1fe045289bd5696a88852f7c` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:20.262677 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4276506b1fe045289bd5696a88852f7c)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:20.264653 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:20.311934 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4276506b1fe045289bd5696a88852f7c', 'request_id': 'req-30a00570-cc20-44d1-99d8-ce2d1403e07e'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:20.319231 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4276506b1fe045289bd5696a88852f7c', 'request_id': 'req-30a00570-cc20-44d1-99d8-ce2d1403e07e'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:20.329396 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4276506b1fe045289bd5696a88852f7c', 'request_id': 'req-30a00570-cc20-44d1-99d8-ce2d1403e07e'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:20.340682 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] The token cache is being invalidate because project 4276506b1fe045289bd5696a88852f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:20.340992 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:20.341707 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:20.343306 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 832/1649] 10.222.0.43 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:20 2022] DELETE /identity/v3/projects/4276506b1fe045289bd5696a88852f7c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:30.002135 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:30.337716 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:58.381913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513075c-91e8-4ae4-b15f-07339cf33400 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:58.382463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513075c-91e8-4ae4-b15f-07339cf33400 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:58.382463 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513075c-91e8-4ae4-b15f-07339cf33400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:58.402255 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-0513075c-91e8-4ae4-b15f-07339cf33400 None None] MFA Rules not processed for user `6c06cf5d26e4459a9cf7a023beb2e3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:58.403432 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0513075c-91e8-4ae4-b15f-07339cf33400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:58.462047 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 818/1650] 10.222.0.43 () {58 vars in 958 bytes} [Sun Oct 9 01:02:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:58.806887 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:58.808577 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:58.877633 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a00570-cc20-44d1-99d8-ce2d1403e07e admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:58.882745 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9555f1-d161-4377-bd2e-348199c72147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:58.883358 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9555f1-d161-4377-bd2e-348199c72147 service neutron] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:58.883638 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9555f1-d161-4377-bd2e-348199c72147 service neutron] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:58.883908 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9555f1-d161-4377-bd2e-348199c72147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:58.886982 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-0f9555f1-d161-4377-bd2e-348199c72147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:58.903051 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9555f1-d161-4377-bd2e-348199c72147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:58.905198 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9555f1-d161-4377-bd2e-348199c72147 service neutron] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:58.915189 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 833/1651] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:59.398860 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513075c-91e8-4ae4-b15f-07339cf33400 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:59.400327 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0513075c-91e8-4ae4-b15f-07339cf33400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:59.469200 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513075c-91e8-4ae4-b15f-07339cf33400 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:59.474347 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1c4e9-fb2c-4bd6-ad81-bb2528e2d8f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536ebcc364834a75beefab0f2b0cc196', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:59.474956 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c4e9-fb2c-4bd6-ad81-bb2528e2d8f0 service placement] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:59.475231 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c4e9-fb2c-4bd6-ad81-bb2528e2d8f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:59.475497 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c4e9-fb2c-4bd6-ad81-bb2528e2d8f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:59.477279 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b1d1c4e9-fb2c-4bd6-ad81-bb2528e2d8f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:59.488692 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1c4e9-fb2c-4bd6-ad81-bb2528e2d8f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:59.490284 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1c4e9-fb2c-4bd6-ad81-bb2528e2d8f0 service placement] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:59.500084 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 819/1652] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:08.911375 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=26 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:09.496307 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=57 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:11.859439 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9555f1-d161-4377-bd2e-348199c72147 service neutron] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:11.861123 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-0f9555f1-d161-4377-bd2e-348199c72147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:11.941986 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9555f1-d161-4377-bd2e-348199c72147 service neutron] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:11.947483 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd93ecc-3516-4b62-a44b-fd97ad2c270b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f960fdabbffa4813a0ea46bb82218f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:11.948124 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93ecc-3516-4b62-a44b-fd97ad2c270b service nova] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:11.948400 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93ecc-3516-4b62-a44b-fd97ad2c270b service nova] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:11.948672 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93ecc-3516-4b62-a44b-fd97ad2c270b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:11.950410 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-8cd93ecc-3516-4b62-a44b-fd97ad2c270b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:11.962503 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd93ecc-3516-4b62-a44b-fd97ad2c270b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:11.964169 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd93ecc-3516-4b62-a44b-fd97ad2c270b service nova] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:11.974264 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 834/1653] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:21.970419 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=34 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:05:07.962425 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1c4e9-fb2c-4bd6-ad81-bb2528e2d8f0 service placement] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:05:07.963901 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-b1d1c4e9-fb2c-4bd6-ad81-bb2528e2d8f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:08.031858 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1c4e9-fb2c-4bd6-ad81-bb2528e2d8f0 service placement] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:05:08.036239 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca91b93-1c4c-4003-8b65-caaa7e414045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a33cbccb6a374b5f941fd4b768ff6766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:05:08.036883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca91b93-1c4c-4003-8b65-caaa7e414045 service neutron] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:08.037159 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca91b93-1c4c-4003-8b65-caaa7e414045 service neutron] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:08.037431 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca91b93-1c4c-4003-8b65-caaa7e414045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:08.039251 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-1ca91b93-1c4c-4003-8b65-caaa7e414045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:08.149876 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca91b93-1c4c-4003-8b65-caaa7e414045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:05:08.151326 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca91b93-1c4c-4003-8b65-caaa7e414045 service neutron] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:05:08.171477 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 820/1654] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:05:11.385817 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa3b2c-4b5c-4101-9d4f-b82e83496b0b None None] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:11.386525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa3b2c-4b5c-4101-9d4f-b82e83496b0b None None] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:11.386525 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa3b2c-4b5c-4101-9d4f-b82e83496b0b None None] PATH_INFO: `/` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:11.387708 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 835/1655] 10.222.0.43 () {54 vars in 921 bytes} [Sun Oct 9 01:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 01:05:11.395071 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94358-7266-47d8-966f-466b8865d1c3 None None] REQUEST_METHOD: `POST` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:11.395566 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94358-7266-47d8-966f-466b8865d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:11.395774 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94358-7266-47d8-966f-466b8865d1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:11.478777 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.auth.core [None req-17f94358-7266-47d8-966f-466b8865d1c3 None None] MFA Rules not processed for user `536ebcc364834a75beefab0f2b0cc196`. Rule list: `[]` (Enabled: `True`). {{(pid=81519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:05:11.480003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-17f94358-7266-47d8-966f-466b8865d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:11.496589 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=100 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:05:11.500967 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 821/1656] 10.222.0.43 () {58 vars in 1018 bytes} [Sun Oct 9 01:05:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:05:11.512350 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa3b2c-4b5c-4101-9d4f-b82e83496b0b None None] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:05:11.527301 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa3b2c-4b5c-4101-9d4f-b82e83496b0b None None] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:05:11.532704 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dc0bd-47c9-4d84-956d-1c8acefc1910 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536ebcc364834a75beefab0f2b0cc196', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:05:11.533245 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dc0bd-47c9-4d84-956d-1c8acefc1910 service placement] REQUEST_METHOD: `GET` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:11.533520 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dc0bd-47c9-4d84-956d-1c8acefc1910 service placement] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:11.533786 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dc0bd-47c9-4d84-956d-1c8acefc1910 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:11.542744 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dc0bd-47c9-4d84-956d-1c8acefc1910 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:05:11.544377 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dc0bd-47c9-4d84-956d-1c8acefc1910 service placement] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:05:11.554267 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 836/1657] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:05:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:05:14.791984 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94358-7266-47d8-966f-466b8865d1c3 None None] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:05:14.793687 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-17f94358-7266-47d8-966f-466b8865d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:14.815186 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94358-7266-47d8-966f-466b8865d1c3 None None] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:05:14.820492 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:05:14.821209 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:14.821542 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:14.821883 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] PATH_INFO: `/v3/users/6c06cf5d26e4459a9cf7a023beb2e3ea` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:14.823049 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c06cf5d26e4459a9cf7a023beb2e3ea)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:05:14.825050 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:05:14.876003 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c06cf5d26e4459a9cf7a023beb2e3ea'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:14.876722 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c06cf5d26e4459a9cf7a023beb2e3ea'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:14.889258 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c06cf5d26e4459a9cf7a023beb2e3ea'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:14.897839 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c06cf5d26e4459a9cf7a023beb2e3ea'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:14.898482 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c06cf5d26e4459a9cf7a023beb2e3ea'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:14.911306 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 822/1658] 10.222.0.43 () {58 vars in 1224 bytes} [Sun Oct 9 01:05:14 2022] DELETE /identity/v3/users/6c06cf5d26e4459a9cf7a023beb2e3ea => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:05:15.113714 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dc0bd-47c9-4d84-956d-1c8acefc1910 service placement] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:05:15.125274 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dc0bd-47c9-4d84-956d-1c8acefc1910 service placement] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:05:15.183694 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:05:15.184386 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:15.184647 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:15.184917 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] PATH_INFO: `/v3/projects/f1a4add361e141ccafc5fa597e521055` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:15.186141 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a4add361e141ccafc5fa597e521055)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:05:15.188063 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:05:15.237159 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a4add361e141ccafc5fa597e521055', 'request_id': 'req-c1870f84-df14-4fee-afb7-c146c5f8499c'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.243529 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a4add361e141ccafc5fa597e521055', 'request_id': 'req-c1870f84-df14-4fee-afb7-c146c5f8499c'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.253655 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a4add361e141ccafc5fa597e521055', 'request_id': 'req-c1870f84-df14-4fee-afb7-c146c5f8499c'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.264144 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] The token cache is being invalidate because project f1a4add361e141ccafc5fa597e521055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:05:15.264549 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.265186 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.266799 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 837/1659] 10.222.0.43 () {58 vars in 1233 bytes} [Sun Oct 9 01:05:15 2022] DELETE /identity/v3/projects/f1a4add361e141ccafc5fa597e521055 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:05:15.270849 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:05:15.272698 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:15.286723 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368b1f0-80fd-4b88-8bcf-7ffdb214caf2 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:05:15.348781 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:05:15.349382 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:15.349649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:15.349913 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] PATH_INFO: `/v3/users/2b89bb10b0f248a5a46690bc68790ead` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:15.351061 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b89bb10b0f248a5a46690bc68790ead)` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:05:15.353052 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:05:15.402640 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b89bb10b0f248a5a46690bc68790ead'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.403309 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b89bb10b0f248a5a46690bc68790ead'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.415555 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b89bb10b0f248a5a46690bc68790ead'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.424470 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b89bb10b0f248a5a46690bc68790ead'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.425152 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.notifications [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b89bb10b0f248a5a46690bc68790ead'} {{(pid=81519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.427359 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:05:15.440314 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 823/1660] 10.222.0.43 () {58 vars in 1224 bytes} [Sun Oct 9 01:05:15 2022] DELETE /identity/v3/users/2b89bb10b0f248a5a46690bc68790ead => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:05:15.622901 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] Authenticating user token {{(pid=81520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:05:15.624464 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.fernet_utils [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:15.637169 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1870f84-df14-4fee-afb7-c146c5f8499c admin admin] Validating token access rules against request {{(pid=81520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:05:15.698213 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98027de25a1b4edcab7ee4843ee0a448', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4515502f4ca44c3b302803eb9e3faf6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:05:15.698846 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:15.699114 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:15.699381 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] PATH_INFO: `/v3/projects/9cbec505bba946e28a7e9e3400aff280` {{(pid=81520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:15.700518 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cbec505bba946e28a7e9e3400aff280)` {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:05:15.702413 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] RBAC: Authorization granted {{(pid=81520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:05:15.724286 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:05:15.752717 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cbec505bba946e28a7e9e3400aff280', 'request_id': 'req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.759683 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cbec505bba946e28a7e9e3400aff280', 'request_id': 'req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.768467 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cbec505bba946e28a7e9e3400aff280', 'request_id': 'req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e'} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.780123 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] The token cache is being invalidate because project 9cbec505bba946e28a7e9e3400aff280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:05:15.780406 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.781083 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG keystone.notifications [None req-f16ee585-1af1-4fd2-9085-b57e2e1f3f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:15.782661 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: [pid: 81520|app: 0|req: 838/1661] 10.222.0.43 () {58 vars in 1233 bytes} [Sun Oct 9 01:05:15 2022] DELETE /identity/v3/projects/9cbec505bba946e28a7e9e3400aff280 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:05:19.875191 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] Authenticating user token {{(pid=81519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:05:19.876852 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:19.968282 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458a9e3-38ff-463f-8efc-a8df75712870 admin admin] Validating token access rules against request {{(pid=81519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:05:20.031575 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6260d2-773c-49d9-bac6-6c4280cecd1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '536ebcc364834a75beefab0f2b0cc196', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49f0d75c457ca693240c8a221037', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:05:20.032208 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6260d2-773c-49d9-bac6-6c4280cecd1e service placement] REQUEST_METHOD: `GET` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:20.032479 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6260d2-773c-49d9-bac6-6c4280cecd1e service placement] SCRIPT_NAME: `/identity` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:20.032744 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6260d2-773c-49d9-bac6-6c4280cecd1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:20.034543 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.fernet_utils [None req-be6260d2-773c-49d9-bac6-6c4280cecd1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:20.053075 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6260d2-773c-49d9-bac6-6c4280cecd1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:05:20.055522 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6260d2-773c-49d9-bac6-6c4280cecd1e service placement] RBAC: Authorization granted {{(pid=81519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:05:20.070649 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: [pid: 81519|app: 0|req: 824/1662] 10.222.0.43 () {60 vars in 1365 bytes} [Sun Oct 9 01:05:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:05:25.777455 dv-osbrick-master-4-iscsi devstack@keystone.service[81520]: DEBUG dbcounter [-] [81520] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:05:30.064709 dv-osbrick-master-4-iscsi devstack@keystone.service[81519]: DEBUG dbcounter [-] [81519] Writing DB stats keystone:SELECT=62 {{(pid=81519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}